vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #256
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.Cn3FZGCelc', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 6f363ca5-c0a6-40e9-849a-53b929f8800b16gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20gitlab # Writing inode tables: 0/8 done21gitlab # Creating journal (8192 blocks): done22gitlab # Writing superblocks and filesystem accounting information: 0/8 done23gitlab # 24(finished: start all VMs, in 50.70 seconds)25gitlab # Virtualisation disk image created.26gitlab # Creating Nix store image...27gitlab # Created Nix store image.28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jv269i0f4x0mqk075s7fm80pg6dy3yr0-nixos-system-gitlab-test/init regInfo=/nix/store/5g7s67cr6fg01gkaq7rc1gwzp3asbi61-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000001] kvm-clock: using sched offset of 465234706 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000810] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000878] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002734] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002745] Using GB pages for direct mapping73gitlab # [ 0.002830] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002837] ACPI: Early table checksum verification disabled75gitlab # [ 0.002840] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002845] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002848] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002856] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002858] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002859] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002861] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002863] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002864] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002865] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002865] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002866] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002866] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002867] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003082] No NUMA configuration found90gitlab # [ 0.003083] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003085] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005547] Zone ranges:93gitlab # [ 0.005548] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005550] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005551] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005552] Device empty97gitlab # [ 0.005553] Movable zone start for each node98gitlab # [ 0.005553] Early memory node ranges99gitlab # [ 0.005554] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005555] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005556] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005557] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005576] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005861] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.120926] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.121351] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.121367] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.121402] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.121405] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.121407] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.121408] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.121409] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.121410] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.121412] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.121414] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.121418] TSC deadline timer available117gitlab # [ 0.121423] CPU topo: Max. logical packages: 1118gitlab # [ 0.121424] CPU topo: Max. logical dies: 1119gitlab # [ 0.121424] CPU topo: Max. dies per package: 1120gitlab # [ 0.121428] CPU topo: Max. threads per core: 1121gitlab # [ 0.121428] CPU topo: Num. cores per package: 4122gitlab # [ 0.121429] CPU topo: Num. threads per package: 4123gitlab # [ 0.121429] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.121454] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.121472] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.121475] kvm-guest: setup PV sched yield127gitlab # [ 0.121497] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.121499] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.121500] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.121502] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.121504] Booting paravirtualized kernel on KVM132gitlab # [ 0.121508] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.125954] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.128295] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.128348] kvm-guest: PV spinlocks enabled136gitlab # [ 0.128350] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.128353] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jv269i0f4x0mqk075s7fm80pg6dy3yr0-nixos-system-gitlab-test/init regInfo=/nix/store/5g7s67cr6fg01gkaq7rc1gwzp3asbi61-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.128453] Unknown kernel command line parameters "regInfo=/nix/store/5g7s67cr6fg01gkaq7rc1gwzp3asbi61-closure-info/registration", will be passed to user space.139gitlab # [ 0.128466] random: crng init done140gitlab # [ 0.128467] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.137859] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.142755] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.142838] software IO TLB: area num 4.144gitlab # [ 0.223217] Fallback order for Node 0: 0145gitlab # [ 0.223226] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.223228] Policy zone: Normal147gitlab # [ 0.225893] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.236241] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.251183] allocated 12582912 bytes of page_ext150gitlab # [ 0.261390] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.261392] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.262251] Dynamic Preempt: lazy153gitlab # [ 0.262440] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.262440] rcu: RCU event tracing is enabled.155gitlab # [ 0.262441] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.262443] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.262443] Rude variant of Tasks RCU enabled.158gitlab # [ 0.262444] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.262445] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.262445] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.262467] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.262469] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.262470] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.266903] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.267187] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.267197] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.267313] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.270943] Console: colour VGA+ 80x25169gitlab # [ 0.270946] printk: legacy console [tty0] enabled170gitlab # [ 0.301856] printk: legacy console [ttyS0] enabled171gitlab # [ 0.400272] ACPI: Core revision 20250807172gitlab # [ 0.401219] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.402723] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.403716] x2apic enabled175gitlab # [ 0.404494] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.405392] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.406605] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.408050] kvm-guest: setup PV IPIs179gitlab # [ 0.409619] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.410626] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.412328] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.414411] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.415461] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.417069] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.418128] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.419326] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.421326] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.422325] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.423326] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.424326] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.425333] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.426326] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.427326] active return thunk: srso_alias_return_thunk194gitlab # [ 0.429020] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.430326] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.431325] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.432324] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.433325] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.434325] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.435325] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.436326] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.437325] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.439100] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.440090] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.441090] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.442096] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.472579] Freeing SMP alternatives memory: 44K208gitlab # [ 0.473331] pid_max: default: 32768 minimum: 301209gitlab # [ 0.474198] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.475414] landlock: Up and running.211gitlab # [ 0.476010] Yama: becoming mindful.212gitlab # [ 0.476542] LSM support for eBPF active213gitlab # [ 0.477588] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.478493] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.481780] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.482946] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.483331] ... version: 2218gitlab # [ 0.484098] ... bit width: 48219gitlab # [ 0.484328] ... generic counters: 6220gitlab # [ 0.485088] ... generic bitmap: 000000000000003f221gitlab # [ 0.485335] ... fixed-purpose counters: 0222gitlab # [ 0.486088] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.486328] ... value mask: 0000ffffffffffff224gitlab # [ 0.487246] ... max period: 00007fffffffffff225gitlab # [ 0.488055] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.488451] signal: max sigframe size: 3376227gitlab # [ 0.489272] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.489971] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.490600] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.496061] smp: Bringing up secondary CPUs ...231gitlab # [ 0.497296] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.497984] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.501475] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.503025] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.503867] Memory: 6011592K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.505328] devtmpfs: initialized237gitlab # [ 0.506475] x86/mm: Memory block size: 128MB238gitlab # [ 0.510386] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.511415] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.512436] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.513563] PM: RTC time: 16:51:39, date: 2026-08-23242gitlab # [ 0.517481] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.519835] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.520392] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.522518] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.523341] audit: initializing netlink subsys (disabled)247gitlab # [ 0.524442] audit: type=2000 audit(1787503899.354:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.524653] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.526329] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.527328] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.528299] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.529078] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.529361] cpuidle: using governor menu254gitlab # [ 0.531543] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.532577] PCI: Using configuration type 1 for base access256gitlab # [ 0.533329] PCI: Using configuration type 1 for extended access257gitlab # [ 0.534433] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.538123] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.540349] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.543338] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.545333] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.552628] ACPI: Added _OSI(Module Device)263gitlab # [ 0.553329] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.554069] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.556316] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.560266] ACPI: Interpreter enabled267gitlab # [ 0.562454] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.563337] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.565423] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.569339] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.571787] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.585648] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.587345] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.591375] acpiphp: Slot [3] registered275gitlab # [ 0.593398] acpiphp: Slot [4] registered276gitlab # [ 0.595411] acpiphp: Slot [5] registered277gitlab # [ 0.596373] acpiphp: Slot [6] registered278gitlab # [ 0.597377] acpiphp: Slot [7] registered279gitlab # [ 0.599392] acpiphp: Slot [8] registered280gitlab # [ 0.600375] acpiphp: Slot [9] registered281gitlab # [ 0.601371] acpiphp: Slot [10] registered282gitlab # [ 0.603371] acpiphp: Slot [11] registered283gitlab # [ 0.604398] acpiphp: Slot [12] registered284gitlab # [ 0.606373] acpiphp: Slot [13] registered285gitlab # [ 0.607370] acpiphp: Slot [14] registered286gitlab # [ 0.608371] acpiphp: Slot [15] registered287gitlab # [ 0.610394] acpiphp: Slot [16] registered288gitlab # [ 0.611376] acpiphp: Slot [17] registered289gitlab # [ 0.612371] acpiphp: Slot [18] registered290gitlab # [ 0.613187] acpiphp: Slot [19] registered291gitlab # [ 0.613872] acpiphp: Slot [20] registered292gitlab # [ 0.615349] acpiphp: Slot [21] registered293gitlab # [ 0.616099] acpiphp: Slot [22] registered294gitlab # [ 0.616356] acpiphp: Slot [23] registered295gitlab # [ 0.617076] acpiphp: Slot [24] registered296gitlab # [ 0.617351] acpiphp: Slot [25] registered297gitlab # [ 0.618106] acpiphp: Slot [26] registered298gitlab # [ 0.619365] acpiphp: Slot [27] registered299gitlab # [ 0.620064] acpiphp: Slot [28] registered300gitlab # [ 0.620348] acpiphp: Slot [29] registered301gitlab # [ 0.621082] acpiphp: Slot [30] registered302gitlab # [ 0.622356] acpiphp: Slot [31] registered303gitlab # [ 0.623126] PCI host bridge to bus 0000:00304gitlab # [ 0.623490] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.625213] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.626202] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.627304] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.628298] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.630341] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.631769] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.633884] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.635815] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.638078] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.639357] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.640329] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.641328] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.642329] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.643550] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.647357] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.649670] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.651647] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.652335] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.653550] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.670424] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.671361] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.672339] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.673517] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.676119] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.681413] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.682335] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.683349] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.695314] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.700878] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.712355] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.714351] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.716389] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.722574] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.733357] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.735350] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.737388] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.743451] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.750363] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.752346] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.754374] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.758822] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.765383] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.766340] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.767328] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.774058] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.786367] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.788352] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.791389] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.797586] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.805355] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.807349] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.809387] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.812349] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.816822] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.822371] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.824375] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.828804] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.834384] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.836337] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.837322] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.839746] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.843361] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.844228] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.846350] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.854704] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.857652] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.859602] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.861599] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.864476] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.868490] iommu: Default domain type: Translated375gitlab # [ 0.869171] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.871607] ACPI: bus type USB registered377gitlab # [ 0.872384] usbcore: registered new interface driver usbfs378gitlab # [ 0.873343] usbcore: registered new interface driver hub379gitlab # [ 0.874280] usbcore: registered new device driver usb380gitlab # [ 0.876458] NetLabel: Initializing381gitlab # [ 0.877097] NetLabel: domain hash size = 128382gitlab # [ 0.877329] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.878318] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.879075] PCI: Using ACPI for IRQ routing385gitlab # [ 0.881372] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.882324] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.882324] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.884332] vgaarb: loaded389gitlab # [ 0.885091] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.886328] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.890441] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.894252] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.895791] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.898906] pnp: PnP ACPI init395gitlab # [ 0.901301] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.913214] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.916114] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.918308] NET: Registered PF_INET protocol family399gitlab # [ 0.922503] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.948670] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.950184] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.951624] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.955557] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.956924] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.958157] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.959792] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.961263] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.962608] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.963592] NET: Registered PF_XDP protocol family410gitlab # [ 0.964436] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.965457] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.966517] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.967663] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.968806] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.970167] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.971178] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.973636] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.976654] PCI: CLS 0 bytes, default 64419gitlab # [ 0.977437] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.978064] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.978537] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.978667] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 1.002038] Initialise system trusted keyrings424gitlab # [ 1.003301] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.015054] Key type asymmetric registered426gitlab # [ 1.015848] Asymmetric key parser 'x509' registered427gitlab # [ 1.016830] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.018446] io scheduler mq-deadline registered429gitlab # [ 1.019283] io scheduler kyber registered430gitlab # [ 1.023570] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.024889] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.027370] Linux agpgart interface v0.103433gitlab # [ 1.028118] ACPI: bus type drm_connector registered434gitlab # [ 1.030532] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.031634] usbserial: USB Serial support registered for generic436gitlab # [ 1.032657] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.032657] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.034981] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.036450] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.037647] NET: Registered PF_INET6 protocol family441gitlab # [ 1.039466] Segment Routing with IPv6442gitlab # [ 1.040171] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.042475] IPI shorthand broadcast: enabled444gitlab # [ 1.046894] sched_clock: Marking stable (909011125, 137127887)->(1069370545, -23231533)445gitlab # [ 1.048720] registered taskstats version 1446gitlab # [ 1.049732] Loading compiled-in X.509 certificates447gitlab # [ 1.059796] Demotion targets for Node 0: null448gitlab # [ 1.060872] Key type .fscrypt registered449gitlab # [ 1.061619] Key type fscrypt-provisioning registered450gitlab # [ 1.062816] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.063778] ima: Allocated hash algorithm: sha1452gitlab # [ 1.064646] ima: No architecture policies found453gitlab # [ 1.065660] PM: Magic number: 6:777:894454gitlab # [ 1.067303] RAS: Correctable Errors collector initialized.455gitlab # [ 1.071743] clk: Disabling unused clocks456gitlab # [ 1.072455] PM: genpd: Disabling unused power domains457gitlab # [ 1.316850] Freeing initrd memory: 29392K458gitlab # [ 1.323966] Freeing unused decrypted memory: 2028K459gitlab # [ 1.330485] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.333173] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.338020] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.341821] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.408958] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.410078] Run /init as init process465gitlab # [ 1.424114] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.447969] fuse: init (API version 7.45)467gitlab # [ 1.456284] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.463238] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.466632] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.502117] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.838635] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.879084] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.881207] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.883227] systemd[1]: Running in initrd.475gitlab # [ 1.885657] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.888463] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.999672] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.065113] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.075085] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.076362] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.077772] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.079082] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.081201] systemd[1]: Reached target Path Units.484gitlab # [ 2.082879] systemd[1]: Reached target Slice Units.485gitlab # [ 2.084256] systemd[1]: Reached target Swaps.486gitlab # [ 2.085070] systemd[1]: Reached target Timer Units.487gitlab # [ 2.086100] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.087407] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.088559] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.089562] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.090565] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.091496] systemd[1]: Reached target Socket Units.493gitlab # [ 2.093710] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.095840] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.097932] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.100845] systemd[1]: Starting Journal Service...497gitlab # [ 2.110204] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.111224] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.119230] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.133903] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.135855] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.144339] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.147575] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config504gitlab # [ 2.150020] systemd-journald[91]: Collecting audit messages is disabled.505gitlab # [ 2.157298] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.164452] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.167113] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev508gitlab # [ 2.169016] netfs: FS-Cache loaded509gitlab # [ 2.175365] 9pnet: Installing 9P2000 support510gitlab # [ 2.175725] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 2.179456] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.512gitlab # [ 2.181430] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.513gitlab # [ 2.183257] systemd[1]: Finished Load Kernel Module 9pnet_virtio.514gitlab # [ 2.185540] systemd[1]: Starting Apply Kernel Variables...515gitlab # [ 2.189298] systemd[1]: Starting Create Static Device Nodes in /dev...516gitlab # [ 2.197317] systemd[1]: Started Journal Service.517gitlab # [ 2.060303] systemd-modules-load[93]: Using 4 probe threads518gitlab # [ 2.062348] systemd-modules-load[93]: Inserted module 'virtio_balloon'519gitlab # [ 2.064958] systemd-modules-load[93]: Inserted module 'virtio_gpu'520gitlab # [ 2.066086] systemd-modules-load[93]: Inserted module 'dm_mod'521gitlab # [ 2.067082] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 2.068151] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 2.070974] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 2.071922] systemd[1]: Reached target Local File Systems.525gitlab # [ 2.072724] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 2.073647] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.083222] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.097309] systemd-udevd[113]: Using default interface naming scheme 'v261'.529gitlab # [ 2.108090] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.130156] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.131495] systemd[1]: Reached target System Initialization.532gitlab # [ 2.132562] systemd[1]: Reached target Basic System.533gitlab # [ 2.358241] SCSI subsystem initialized534gitlab # [ 2.373280] virtio_blk virtio4: 4/0/0 default/read/poll queues535gitlab # [ 2.378077] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)536gitlab # [ 2.385428] uhci_hcd 0000:00:01.2: UHCI Host Controller537gitlab # [ 2.386181] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1538gitlab # [ 2.387235] uhci_hcd 0000:00:01.2: detected 2 ports539gitlab # [ 2.392727] virtio_blk virtio5: 4/0/0 default/read/poll queues540gitlab # [ 2.393913] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140541gitlab # [ 2.395263] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12542gitlab # [ 2.395370] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18543gitlab # [ 2.398417] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1544gitlab # [ 2.398536] serio: i8042 KBD port at 0x60,0x64 irq 1545gitlab # [ 2.398770] usb usb1: Product: UHCI Host Controller546gitlab # [ 2.398986] serio: i8042 AUX port at 0x60,0x64 irq 12547gitlab # [ 2.399230] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd548gitlab # [ 2.401190] scsi host0: ata_piix549gitlab # [ 2.403627] virtio_blk virtio5: [vdb] 11830920 512-byte logical blocks (6.06 GB/5.64 GiB)550gitlab # [ 2.405043] usb usb1: SerialNumber: 0000:00:01.2551gitlab # [ 2.409998] scsi host1: ata_piix552gitlab # [ 2.410754] hub 1-0:1.0: USB hub found553gitlab # [ 2.410984] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0554gitlab # [ 2.411322] hub 1-0:1.0: 2 ports detected555gitlab # [ 2.414171] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.285505] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.287425] (udev-worker)[141]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.558gitlab # [ 2.289762] (udev-worker)[141]: Network interface NamePolicy= disabled on kernel command line.559gitlab # [ 2.293076] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 2.304774] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.306072] systemd[1]: Reached target Initrd Root Device.562gitlab # [ 2.308795] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...563gitlab # [ 2.311938] systemd[1]: Found device /dev/disk/by-label/nix-store.564gitlab # [ 2.314433] systemd-vconsole-setup[153]: Configuration of first virtual console was skipped, ignoring remaining ones.565gitlab # [ 2.319560] systemd[1]: Finished Virtual Console Setup.566gitlab # [ 2.332381] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.335558] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.572614] ata2: found unknown device (class 0)569gitlab # [ 2.575572] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100570gitlab # [ 2.579739] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5571gitlab # [ 2.616607] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0572gitlab # [ 2.637232] usb 1-1: new full-speed USB device number 2 using uhci_hcd573gitlab # [ 2.649436] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.676911] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.805363] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.808210] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.810788] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.812683] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.814096] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.846976] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.858601] usbcore: registered new interface driver usbhid582gitlab # [ 2.860563] usbhid: USB HID core driver583gitlab # [ 2.869817] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.873950] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.987293] systemd[1]: Mounting /sysroot...586gitlab # [ 3.282400] EXT4-fs (vda): mounted filesystem 6f363ca5-c0a6-40e9-849a-53b929f8800b r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.152135] systemd[1]: Mounted /sysroot.588gitlab # [ 3.153568] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.157333] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.159271] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.162709] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.164555] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.180366] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.190291] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.329423] 9p: Installing v9fs 9p2000 file system support596gitlab # [ 3.197905] systemd[1]: Mounted /sysroot/run.597gitlab # [ 3.199715] systemd[1]: Mounted /sysroot/nix/.rw-store.598gitlab # [ 3.201334] systemd[1]: Mounted /sysroot/tmp/shared.599gitlab # [ 3.202807] systemd[1]: Mounted /sysroot/tmp/xchg.600gitlab # [ 3.205099] systemd[1]: Starting rw-sysroot-nix-store.service...601gitlab # [ 3.346431] erofs (device vdb): mounted with root inode @ nid 128.602gitlab # [ 3.212799] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.603gitlab # [ 3.215414] systemd[1]: Mounted /sysroot/nix/.ro-store.604gitlab # [ 3.216970] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...605gitlab # [ 3.219418] systemd[1]: Reloading...606gitlab # [ 3.281183] systemd[1]: Reloading finished in 63 ms.607gitlab # [ 3.301444] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...608gitlab # [ 3.304539] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.307290] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.309296] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...611gitlab # [ 3.311788] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.313895] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.316336] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.318585] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.326480] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.328880] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.987559] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 4.038056] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 4.040138] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 4.042211] systemd[1]: Starting Find NixOS closure...621gitlab # [ 4.044336] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 4.075308] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 4.077991] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.096267] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.097986] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.099904] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.129963] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.131957] systemd[1]: Stopped target Basic System.629gitlab # [ 4.133662] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.135460] systemd[1]: Stopped target Path Units.631gitlab # [ 4.137099] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.139422] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.141779] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.143552] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.147506] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.149453] systemd[1]: Stopped target Swaps.637gitlab # [ 4.151372] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.154079] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.156257] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.158298] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.160626] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.162345] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.165514] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.167311] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.169152] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.170727] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.172739] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.174348] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.176430] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.178369] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.180241] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.181838] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.183287] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.184931] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.186191] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.187188] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.188454] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.189749] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.190759] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.191922] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.193082] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.194279] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.195280] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.196287] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.197220] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.198136] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.198823] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.199573] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.200567] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.201378] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.202367] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.203271] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.204184] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.228693] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.230425] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.231211] systemd[1]: Reached target Switch Root.677gitlab # [ 4.232273] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.351588] initrd-nixos-activation-start[227]: booting system configuration /nix/store/jv269i0f4x0mqk075s7fm80pg6dy3yr0-nixos-system-gitlab-test679gitlab # [ 4.407053] initrd-nixos-activation-start[227]: running activation script...680gitlab # [ 4.650113] initrd-nixos-activation-start[250]: setting up /etc...681gitlab # [ 4.768377] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.770928] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.773104] systemd[1]: Starting Switch Root...684gitlab # [ 4.807979] systemd[1]: Switching root.685gitlab # [ 5.009332] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 5.146104] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.512018] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.521611] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.523388] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.525276] systemd[1]: Detected first boot.691gitlab # [ 5.527737] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.670089] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.765926] systemd[1]: Applying preset policy.694gitlab # [ 5.918416] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 6.034196] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 6.035465] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 6.037748] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 6.039749] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 6.041038] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 6.042541] systemd[1]: Created slice User and Session Slice.701gitlab # [ 6.043396] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 6.044528] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 6.045763] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 6.046492] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 6.047197] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 6.047994] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 6.048740] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 6.049533] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 6.050353] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 6.051267] systemd[1]: Reached target Path Units.711gitlab # [ 6.051958] systemd[1]: Reached target Remote File Systems.712gitlab # [ 6.052771] systemd[1]: Reached target Slice Units.713gitlab # [ 6.053466] systemd[1]: Reached target Swaps.714gitlab # [ 6.054823] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 6.056812] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 6.058174] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 6.059739] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 6.060645] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 6.063072] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 6.064631] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 6.066573] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 6.067736] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 6.068829] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 6.070081] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 6.072920] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 6.073934] systemd[1]: Listening on udev Control Socket.727gitlab # [ 6.074796] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 6.077764] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 6.079894] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 6.081878] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 6.085203] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 6.092372] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 6.095418] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 6.105325] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 6.107427] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 6.110887] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 6.114699] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 6.155913] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 6.157675] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 6.165293] systemd[1]: Starting Journal Service...741gitlab # [ 6.168792] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 6.171405] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 6.174776] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 6.175791] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.183254] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.185922] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 6.186611] systemd-journald[322]: Collecting audit messages is enabled.748gitlab # [ 6.187503] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 6.188807] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 6.189822] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 6.190738] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 6.192068] systemd[1]: Finished Create List of Static Device Nodes.753gitlab # [ 6.193365] systemd[1]: modprobe@configfs.service: Deactivated successfully.754gitlab # [ 6.194695] systemd[1]: Finished Load Kernel Module configfs.755gitlab # [ 6.196056] systemd[1]: Mounted FUSE Control File System.756gitlab # [ 6.198922] systemd[1]: Mounting Kernel Configuration File System...757gitlab # [ 6.204211] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...758gitlab # [ 6.207194] EXT4-fs (vda): re-mounted 6f363ca5-c0a6-40e9-849a-53b929f8800b.759gitlab # [ 6.212750] systemd[1]: Finished Remount Root and Kernel File Systems.760gitlab # [ 6.078519] systemd[1]: Queued start job for default target Multi-User System.761gitlab # [ 6.080342] systemd[1]: Unnecessary job was removed for /dev/vdb.762gitlab # [ 6.218272] systemd[1]: Started Journal Service.763gitlab # [ 6.082974] systemd[1]: systemd-journald.service: Deactivated successfully.764gitlab # [ 6.086410] systemd-modules-load[323]: Using 3 probe threads765gitlab # [ 6.088536] systemd-modules-load[323]: Inserted module 'tls'766gitlab # [ 6.090545] systemd[1]: Listening on Disk Image Download Service Socket.767gitlab # [ 6.093187] systemd[1]: Starting Flush Journal to Persistent Storage...768gitlab # [ 6.232355] loop: module loaded769gitlab # [ 6.095630] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore770gitlab # [ 6.099583] systemd-oomd[325]: No swap; memory pressure usage will be degraded771gitlab # [ 6.101774] systemd[1]: Starting Load/Save OS Random Seed...772gitlab # [ 6.102722] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 6.104047] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.774gitlab # [ 6.105043] systemd-modules-load[323]: Inserted module 'loop'775gitlab # [ 6.105966] systemd[1]: Mounted Kernel Configuration File System.776gitlab # [ 6.107200] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.777gitlab # [ 6.108445] systemd[1]: Starting Create Static Device Nodes in /dev...778gitlab # [ 6.109355] systemd[1]: Finished Load Kernel Modules.779gitlab # [ 6.248219] systemd-journald[322]: Received client request to flush runtime journal.780gitlab # [ 6.153490] systemd[1]: Starting Firewall...781gitlab # [ 6.155360] systemd[1]: Starting Apply Kernel Variables...782gitlab # [ 6.156321] systemd[1]: Finished Load/Save OS Random Seed.783gitlab # [ 6.157689] systemd[1]: Reached target First Boot Complete.784gitlab # [ 6.159747] systemd[1]: Finished Create Static Device Nodes in /dev.785gitlab # [ 6.160760] systemd[1]: Reached target Preparation for Local File Systems.786gitlab # [ 6.161785] systemd[1]: Starting Rule-based Manager for Device Events and Files...787gitlab # [ 6.162813] systemd[1]: Finished Apply Kernel Variables.788gitlab # [ 6.163575] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 6.167668] systemd-udevd[352]: Using default interface naming scheme 'v261'.790gitlab # [ 6.198155] systemd[1]: Started Rule-based Manager for Device Events and Files.791gitlab # [ 6.206128] systemd[1]: Finished Coldplug All udev Devices.792gitlab # [ 6.270052] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.282599] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.324265] (udev-worker)[417]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 6.326243] (udev-worker)[410]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.796gitlab # [ 6.328311] (udev-worker)[410]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 6.338235] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.798gitlab # [ 6.339514] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 6.340947] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 6.342656] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 6.345257] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 6.346867] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.348046] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.511028] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3805gitlab # [ 6.516212] ACPI: button: Power Button [PWRF]806gitlab # [ 6.526000] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0807gitlab # [ 6.528338] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD808gitlab # [ 6.544745] parport_pc 00:03: reported by Plug and Play ACPI809gitlab # [ 6.545606] rtc_cmos 00:05: RTC can wake from S4810gitlab # [ 6.545786] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]811gitlab # [ 6.549532] rtc_cmos 00:05: registered as rtc0812gitlab # [ 6.549724] Floppy drive(s):813gitlab # [ 6.549887] rtc_cmos 00:05: setting system clock to 2026-08-23T16:51:45 UTC (1787503905)814gitlab # [ 6.552388] fd0 is 2.88M AMI BIOS815gitlab # [ 6.555383] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs816gitlab # [ 6.563582] FDC 0 is a S82078B817gitlab # [ 6.571038] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5818gitlab # [ 6.571584] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console819gitlab # [ 6.573332] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4820gitlab # [ 6.574683] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6821gitlab # [ 6.588219] Console: switching to colour dummy device 80x25822gitlab # [ 6.590644] [drm] Found bochs VGA, ID 0xb0c5.823gitlab # [ 6.590646] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.824gitlab # [ 6.599342] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic825gitlab # [ 6.600059] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0826gitlab # [ 6.473795] systemd[1]: Finished Firewall.827gitlab # [ 6.634351] mousedev: PS/2 mouse device common for all mice828gitlab # [ 6.649637] Console: switching to colour frame buffer device 160x50829gitlab # [ 6.651532] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device830gitlab # [ 6.529346] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.559085] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.565314] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.723862] ppdev: user-space parallel port driver834gitlab # [ 6.593496] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 6.733761] kvm_amd: TSC scaling supported836gitlab # [ 6.734298] kvm_amd: Nested Virtualization enabled837gitlab # [ 6.734740] kvm_amd: Nested Paging enabled838gitlab # [ 6.735190] kvm_amd: LBR virtualization supported839gitlab # [ 6.735652] kvm_amd: Virtual VMLOAD VMSAVE supported840gitlab # [ 6.736089] kvm_amd: Virtual GIF supported841gitlab # [ 6.736577] kvm_amd: Virtual NMI enabled842gitlab # [ 6.769447] EDAC MC: Ver: 3.0.0843gitlab # [ 6.659641] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones.844gitlab # [ 6.662215] systemd[1]: Finished Virtual Console Setup.845gitlab # [ 6.902631] systemd[1]: Mounting /run/wrappers...846gitlab # [ 6.924114] systemd[1]: Mounted /run/wrappers.847gitlab # [ 6.925926] systemd[1]: Reached target Local File Systems.848gitlab # [ 6.927840] systemd[1]: Listening on Boot Loader Control Service Socket.849gitlab # [ 6.930105] systemd[1]: Starting register-nix-paths.service...850gitlab # [ 6.932138] systemd[1]: Starting Create SUID/SGID Wrappers...851gitlab # [ 6.934133] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852gitlab # [ 6.937114] systemd[1]: Starting Save Transient machine-id to Disk...853gitlab # [ 6.944275] systemd[1]: Starting Create System Files and Directories...854gitlab # [ 6.974373] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.855gitlab # [ 6.976812] systemd[1]: Finished Save Transient machine-id to Disk.856gitlab # [ 6.994838] systemd[1]: Finished Create System Files and Directories.857gitlab # [ 6.999073] systemd[1]: Starting Rebuild Journal Catalog...858gitlab # [ 7.000947] systemd[1]: Starting Record System Boot/Shutdown in UTMP...859gitlab # [ 7.020611] systemd[1]: Finished Record System Boot/Shutdown in UTMP.860gitlab # [ 7.036503] systemd[1]: Finished Rebuild Journal Catalog.861gitlab # [ 7.038030] systemd[1]: Starting Update is Completed...862gitlab # [ 7.054234] systemd[1]: Finished Update is Completed.863gitlab # [ 7.089054] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.864gitlab # [ 7.090266] systemd[1]: Finished Create SUID/SGID Wrappers.865gitlab # [ 7.335516] systemd[1]: Finished register-nix-paths.service.866gitlab # [ 7.337839] systemd[1]: Reached target System Initialization.867gitlab # [ 7.339865] systemd[1]: Started Discard unused filesystem blocks once a week.868gitlab # [ 7.342404] systemd[1]: Started logrotate.timer.869gitlab # [ 7.344171] systemd[1]: Started Daily Cleanup of Temporary Directories.870gitlab # [ 7.346427] systemd[1]: Reached target Timer Units.871gitlab # [ 7.348247] systemd[1]: Listening on D-Bus System Message Bus Socket.872gitlab # [ 7.350459] systemd[1]: Listening on Nix Daemon Socket.873gitlab # [ 7.352405] systemd[1]: Starting nixbot CI service socket...874gitlab # [ 7.354445] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.875gitlab # [ 7.357251] systemd[1]: Starting D-Bus System Message Bus...876gitlab # [ 7.359282] systemd[1]: Listening on nixbot CI service socket.877gitlab # [ 7.361276] systemd[1]: Reached target Socket Units.878gitlab # [ 7.427157] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'...879gitlab # [ 7.430516] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync'880gitlab # [ 7.433414] dbus-broker-launch[578]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"881gitlab # [ 7.438741] systemd[1]: Started D-Bus System Message Bus.882gitlab # [ 7.451705] dbus-broker-launch[578]: Ready883gitlab # [ 7.454272] systemd[1]: Reached target Basic System.884gitlab # [ 7.456675] systemd[1]: Started backdoor.service.885gitlab # [ 7.459053] systemd[1]: Starting gitlab-config.service...886gitlab # [ 7.461995] systemd[1]: Starting Import lastlog data into lastlog2 database...887gitlab # [ 7.473477] systemd[1]: Starting Logrotate configuration check...888gitlab # [ 7.482181] systemd[1]: Starting Name Service Cache Daemon (nsncd)...889gitlab # [ 7.488754] systemd[1]: Starting Post-Boot Actions...890gitlab # [ 7.492053] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.891gitlab # [ 7.497627] logrotate[583]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf892gitlab # [ 7.500941] logrotate[583]: note: 'monthly' overrides previously specified 'weekly'893gitlab # [ 7.503422] logrotate[583]: Reading state from file: /var/lib/logrotate.status894gitlab # [ 7.505254] logrotate[583]: state file /var/lib/logrotate.status does not exist895gitlab # connecting to host...896gitlab # [ 7.507618] logrotate[583]: Allocating hash table for state file, size 64 entries897gitlab # [ 7.509619] logrotate[583]: Handling 4 logs898gitlab # [ 7.510785] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed899gitlab # [ 7.518451] logrotate[583]: considering log /var/log/btmp900gitlab # [ 7.519101] logrotate[583]: Creating new state901gitlab # [ 7.520431] logrotate[583]: Now: 2026-08-23 16:51902gitlab: Guest shell says: b'Spawning backdoor root shell...\n'903gitlab # [ 7.522368] logrotate[583]: Last rotated at 2026-08-23 16:00904gitlab # [ 7.523151] logrotate[583]: log does not need rotating (log has already been rotated)905gitlab: connected to guest root shell906gitlab # [ 7.524344] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed907gitlab: (connecting took 8.14 seconds)908gitlab # [ 7.524929] logrotate[583]: considering log /var/log/wtmp909gitlab: (finished: waiting for the VM to finish booting, in 8.14 seconds)910gitlab # [ 7.525581] logrotate[583]: Creating new state911gitlab # [ 7.526717] logrotate[583]: Now: 2026-08-23 16:51912gitlab # [ 7.527349] logrotate[583]: Last rotated at 2026-08-23 16:00913gitlab # [ 7.528707] logrotate[583]: log does not need rotating (log has already been rotated)914gitlab # [ 7.529343] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed915gitlab # [ 7.529911] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583)916gitlab # [ 7.530488] logrotate[583]: considering log /var/gitlab/state/log/*.log917gitlab # [ 7.530924] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping918gitlab # [ 7.531510] logrotate[583]: Creating new state919gitlab # [ 7.531939] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583)920gitlab # [ 7.532543] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed921gitlab # [ 7.532811] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583)922gitlab # [ 7.533368] logrotate[583]: considering log /var/log/nginx/*.log923gitlab # [ 7.533803] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping924gitlab # [ 7.534382] logrotate[583]: Creating new state925gitlab # [ 7.534812] logrotate[583]: not running postrotate script, since no logs were rotated926gitlab # [ 7.535477] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583)927gitlab # [ 7.536104] systemd[1]: Started Reset console on configuration changes.928gitlab # [ 7.536691] systemd[1]: Starting resolvconf update...929gitlab # [ 7.542362] nsncd[584]: Aug 23 16:51:46.615 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"930gitlab # [ 7.543225] systemd[1]: Finished Logrotate configuration check.931gitlab # [ 7.544027] systemd[1]: Finished Post-Boot Actions.932gitlab # [ 7.544889] systemd[1]: Started Name Service Cache Daemon (nsncd).933gitlab # [ 7.545691] systemd[1]: Finished Import lastlog data into lastlog2 database.934gitlab # [ 7.552442] systemd[1]: Reached target Host and Network Name Lookups.935gitlab # [ 7.552936] systemd[1]: Reached target User and Group Name Lookups.936gitlab # [ 7.556329] systemd[1]: Starting User Login Management...937gitlab # [ 7.577563] systemd[1]: Stopped target Host and Network Name Lookups.938gitlab # [ 7.579686] systemd[1]: Stopping Host and Network Name Lookups...939gitlab # [ 7.580649] systemd[1]: Stopped target User and Group Name Lookups.940gitlab # [ 7.581561] systemd[1]: Stopping User and Group Name Lookups...941gitlab # [ 7.583360] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...942gitlab # [ 7.584247] systemd[1]: nscd.service: Deactivated successfully.943gitlab # [ 7.585048] systemd[1]: Stopped Name Service Cache Daemon (nsncd).944gitlab # [ 7.585937] systemd[1]: nscd.service: Consumed 34ms CPU time over 101ms wall clock time, 7.4M memory peak, 5.5M read from disk.945gitlab # [ 7.587865] systemd[1]: Starting Name Service Cache Daemon (nsncd)...946gitlab # [ 7.599274] systemd-logind[639]: New seat seat0.947gitlab # [ 7.606593] systemd[1]: Started Name Service Cache Daemon (nsncd).948gitlab # [ 7.607340] systemd-logind[639]: Watching system buttons on /dev/input/event2 (Power Button)949gitlab # [ 7.608788] systemd-logind[639]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)950gitlab # [ 7.609259] systemd-logind[639]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)951gitlab # [ 7.609726] systemd[1]: Finished resolvconf update.952gitlab # [ 7.610252] systemd[1]: Started User Login Management.953gitlab # [ 7.612736] nsncd[674]: Aug 23 16:51:46.699 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"954gitlab # [ 7.613292] systemd[1]: Reached target Preparation for Network.955gitlab # [ 7.614042] systemd[1]: Reached target Host and Network Name Lookups.956gitlab # [ 7.614631] systemd[1]: Reached target User and Group Name Lookups.957gitlab # [ 7.615632] systemd[1]: Starting DHCP Client...958gitlab # [ 7.619295] systemd[1]: Starting linger-users.service...959gitlab # [ 7.621494] systemd[1]: Starting Address configuration of eth1...960gitlab # [ 7.630303] systemd[1]: Starting Extra networking commands....961gitlab # [ 7.636412] systemd[1]: linger-users.service: Deactivated successfully.962gitlab # [ 7.638767] systemd[1]: Finished linger-users.service.963gitlab # [ 7.652588] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done964gitlab # [ 7.656628] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done965gitlab # [ 7.662114] systemd[1]: Finished Address configuration of eth1.966gitlab # [ 7.699539] systemd[1]: Finished Extra networking commands..967gitlab # [ 7.700984] systemd[1]: Reached target Network.968gitlab # [ 7.702369] dhcpcd[717]: dhcpcd-10.3.2 starting969gitlab # [ 7.703500] dhcpcd[766]: dev: loaded udev970gitlab # [ 7.704376] systemd[1]: Starting gitlab-workhorse.service...971gitlab # [ 7.707570] systemd[1]: Starting Nginx Web Server...972gitlab # [ 7.845698] 8021q: 802.1Q VLAN Support v1.8973gitlab # [ 7.846531] 8021q: adding VLAN 0 to HW filter on device eth1974gitlab # [ 7.710412] systemd[1]: Starting PostgreSQL Server...975gitlab # [ 7.713835] systemd[1]: Starting Redis Server - redis-gitlab...976gitlab # [ 7.718095] systemd[1]: Starting Permit User Sessions...977gitlab # [ 7.724938] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.978gitlab # [ 7.747992] systemd[1]: Finished Permit User Sessions.979gitlab # [ 7.753572] systemd[1]: Started Getty on tty1.980gitlab # [ 7.754466] systemd[1]: Reached target Login Prompts.981gitlab # [ 7.932737] cfg80211: Loading compiled-in X.509 certificates for regulatory database982gitlab # [ 7.939427] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'983gitlab # [ 7.940356] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'984gitlab # [ 7.941602] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2985gitlab # [ 7.942429] cfg80211: failed to load regulatory.db986gitlab # [ 7.978363] 8021q: adding VLAN 0 to HW filter on device eth0987gitlab # [ 7.843385] dhcpcd[766]: eth0: waiting for carrier988gitlab # [ 7.843794] dhcpcd[766]: eth0: carrier acquired989gitlab # [ 7.850049] dhcpcd[766]: DUID 00:01:00:01:32:1d:e1:a2:52:54:00:12:34:56990gitlab # [ 7.850639] dhcpcd[766]: eth0: IAID 00:12:34:56991gitlab # [ 7.851363] dhcpcd[766]: eth0: adding address fe80::5054:ff:fe12:3456992gitlab # [ 7.859308] nginx-pre-start[788]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok993gitlab # [ 7.860840] nginx-pre-start[788]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful994gitlab # [ 7.864717] systemd[1]: Started Nginx Web Server.995gitlab # [ 7.870892] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres".996gitlab # [ 7.871636] postgresql-pre-start[791]: This user must also own the server process.997gitlab # [ 7.874321] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8".998gitlab # [ 7.874926] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8".999gitlab # [ 7.875564] postgresql-pre-start[791]: The default text search configuration will be set to "english".1000gitlab # [ 7.876136] postgresql-pre-start[791]: Data page checksums are enabled.1001gitlab # [ 7.878915] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1002gitlab # [ 7.879577] postgresql-pre-start[791]: creating subdirectories ... ok1003gitlab # [ 7.880232] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix1004gitlab # [ 7.884573] redis-server[795]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1005gitlab # [ 7.885351] redis-server[795]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1006gitlab # [ 7.886046] redis-server[795]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=795, just started1007gitlab # [ 7.886462] redis-server[795]: Configuration loaded1008gitlab # [ 7.886913] redis[795]: monotonic clock: POSIX clock_gettime1009gitlab # [ 7.887722] redis[795]: Running mode=standalone, port=0.1010gitlab # [ 7.888526] redis[795]: Server initialized1011gitlab # [ 7.889187] systemd[1]: Started Redis Server - redis-gitlab.1012gitlab # [ 7.889788] redis[795]: Ready to accept connections unix1013gitlab # [ 7.890207] redis[795]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1014gitlab # [ 7.925967] postgresql-pre-start[791]: selecting default "max_connections" ... 1001015gitlab # [ 7.974225] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 8.224404] systemd[1]: Started gitlab-workhorse.service.1017gitlab # [ 8.381483] postgresql-pre-start[791]: selecting default time zone ... UTC1018gitlab # [ 8.384053] postgresql-pre-start[791]: creating configuration files ... ok1019gitlab # [ 8.448695] gitlab-workhorse[826]: time="2026-08-23T16:51:47Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41020gitlab # [ 8.452356] gitlab-workhorse[826]: time="2026-08-23T16:51:47Z" level=info msg="Using redis/go-redis"1021gitlab # [ 8.453601] gitlab-workhorse[826]: time="2026-08-23T16:51:47Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1022gitlab # [ 8.570779] postgresql-pre-start[791]: running bootstrap script ... ok1023gitlab # [ 8.650748] dhcpcd[766]: eth0: soliciting a DHCP lease1024gitlab # [ 8.793173] NET: Registered PF_PACKET protocol family1025gitlab # [ 8.663979] dhcpcd[766]: eth0: offered 10.0.2.15 from 10.0.2.21026gitlab # [ 8.671318] dhcpcd[766]: eth0: probing address 10.0.2.15/241027gitlab # [ 9.031058] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok1028gitlab # [ 9.343244] postgresql-pre-start[791]: syncing data to disk ... ok1029gitlab # [ 9.345115] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections1030gitlab # [ 9.346420] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1031gitlab # [ 9.347831] postgresql-pre-start[791]: Success. You can now start the database server using:1032gitlab # [ 9.349294] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1033gitlab # [ 9.494806] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1034gitlab # [ 9.496963] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 54321035gitlab # [ 9.498153] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 54321036gitlab # [ 9.504838] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1037gitlab # [ 9.520507] postgres[866]: [866] LOG: database system was shut down at 2026-08-23 16:51:48 GMT1038gitlab # [ 9.531283] postgres[852]: [852] LOG: database system is ready to accept connections1039gitlab # [ 9.536631] systemd[1]: Started PostgreSQL Server.1040gitlab # [ 9.539506] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[856]: mkdir -p /var/gitlab/state/home/.ssh: OK1041gitlab # [ 9.543258] systemd[1]: Starting PostgreSQL Setup Scripts...1042gitlab # [ 9.545430] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[856]: chmod 700 /var/gitlab/state/home/.ssh: OK1043gitlab # [ 9.588189] systemd[1]: Finished gitlab-config.service.1044gitlab # [ 9.590943] systemd[1]: Started gitaly.service.1045gitlab # [ 9.744228] postgresql-setup-start[895]: CREATE DATABASE1046gitlab # [ 9.771456] postgresql-setup-start[910]: CREATE ROLE1047gitlab # [ 9.782399] postgresql-setup-start[912]: ALTER DATABASE1048gitlab # [ 9.804374] postgresql-setup-start[917]: CREATE ROLE1049gitlab # [ 9.808066] systemd[1]: Finished PostgreSQL Setup Scripts.1050gitlab # [ 9.808702] systemd[1]: Reached target PostgreSQL.1051gitlab # [ 9.813062] systemd[1]: Starting gitlab-db-config.service...1052gitlab # [ 9.813578] systemd[1]: Starting gitlab-postgresql.service...1053gitlab # [ 9.907576] gitlab-postgresql-start[928]: CREATE DATABASE1054gitlab # [ 9.912268] dhcpcd[766]: eth0: soliciting an IPv6 router1055gitlab # [ 9.912976] dhcpcd[766]: eth0: Router Advertisement from fe80::21056gitlab # [ 9.913563] dhcpcd[766]: eth0: adding address fec0::5054:ff:fe12:3456/641057gitlab # [ 9.913986] dhcpcd[766]: eth0: adding route to fec0::/641058gitlab # [ 9.916376] dhcpcd[766]: eth0: adding default route via fe80::21059gitlab # [ 9.954512] gitlab-postgresql-start[933]: CREATE EXTENSION1060gitlab # [ 10.040489] gitlab-postgresql-start[935]: CREATE EXTENSION1061gitlab # [ 10.046067] systemd[1]: Finished gitlab-postgresql.service.1062gitlab # [ 10.075822] gitaly[885]: time="2026-08-23T16:51:49.162Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8851063gitlab # [ 10.076959] gitaly[885]: time="2026-08-23T16:51:49.162Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8851064gitlab # [ 10.077942] gitaly[885]: time="2026-08-23T16:51:49.163Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8851065gitlab # [ 10.078943] gitaly[885]: time="2026-08-23T16:51:49.163Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8851066gitlab # [ 10.080030] gitaly[885]: time="2026-08-23T16:51:49.163Z" level=info msg="Starting Gitaly" pid=885 version=1067gitlab # [ 10.275259] gitaly[885]: time="2026-08-23T16:51:49.362Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=198 pid=8851068gitlab # [ 10.276112] gitaly[885]: time="2026-08-23T16:51:49.362Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8851069gitlab # [ 10.279827] gitaly[885]: time="2026-08-23T16:51:49.366Z" level=info msg="finished initializing command factory" duration_ms=4 pid=8851070gitlab # [ 10.280383] gitaly[885]: time="2026-08-23T16:51:49.367Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-885/git-exec-4264800935.d/git pid=8851071gitlab # [ 10.287661] gitaly[885]: time="2026-08-23T16:51:49.374Z" level=info msg="finished detecting git version" duration_ms=7 pid=8851072gitlab # [ 10.288355] gitaly[885]: time="2026-08-23T16:51:49.374Z" level=info msg="using Git version" pid=885 version=2.53.g1073gitlab # [ 10.290088] gitaly[885]: time="2026-08-23T16:51:49.374Z" level=info msg="clearing disk cache object folder" pid=885 storage=default1074gitlab # [ 10.291652] gitaly[885]: time="2026-08-23T16:51:49.378Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3537196406 pid=885 storage=default1075gitlab # [ 10.292086] gitaly[885]: time="2026-08-23T16:51:49.378Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3537196406 pid=885 storage=default1076gitlab # [ 10.292608] gitaly[885]: time="2026-08-23T16:51:49.378Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8851077gitlab # [ 10.297911] gitaly[885]: time="2026-08-23T16:51:49.385Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3537196406 clear_duration_ms=0 pid=885 storage=default1078gitlab # [ 10.298466] gitaly[885]: time="2026-08-23T16:51:49.378Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8851079gitlab # [ 10.337987] gitaly[885]: time="2026-08-23T16:51:49.424Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8851080gitlab # [ 10.338528] gitaly[885]: time="2026-08-23T16:51:49.424Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=885 schema=unix1081gitlab # [ 10.338947] gitaly[885]: time="2026-08-23T16:51:49.424Z" level=info msg="counting repositories" pid=8851082gitlab # [ 10.339808] gitaly[885]: time="2026-08-23T16:51:49.424Z" level=info msg="starting to count repositories" pid=885 storage_path=/var/gitlab/state/repositories1083gitlab # [ 10.340533] gitaly[885]: time="2026-08-23T16:51:49.425Z" level=info msg="finished tempdir cleaner walk" pid=885 storage=default time_ms=01084gitlab # [ 10.340963] gitaly[885]: time="2026-08-23T16:51:49.425Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=885 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.341549] gitaly[885]: time="2026-08-23T16:51:49.425Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8851086gitlab # [ 10.341967] gitaly[885]: time="2026-08-23T16:51:49.424Z" level=info msg="listening at address" address=/run/gitaly/gitaly-885/sock.d/intern pid=885 schema=unix1087gitlab # [ 10.350952] gitaly[885]: time="2026-08-23T16:51:49.438Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8851088gitlab # [ 10.351573] gitaly[885]: time="2026-08-23T16:51:49.438Z" level=info msg="Started Gitaly" duration_ms=274 pid=8851089gitlab # [ 10.352163] gitaly[885]: time="2026-08-23T16:51:49.438Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8851090gitlab # [ 10.352836] gitaly[885]: time="2026-08-23T16:51:49.439Z" level=info msg="maintenance: daily scheduled" pid=885 scheduled="2026-08-24 12:00:00 +0000 UTC"1091gitlab # [ 11.112316] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[923]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 11.114230] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[923]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 11.137653] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[923]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 12.258557] gitaly[885]: time="2026-08-23T16:51:51.344Z" level=info msg="License database preloaded" duration_ms=2161 pid=8851095gitlab # [ 13.701493] dhcpcd[766]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 13.703759] dhcpcd[766]: eth0: adding route to 10.0.2.0/241097gitlab # [ 13.705704] dhcpcd[766]: eth0: adding default route via 10.0.2.21098gitlab # [ 13.831345] systemd[1]: Started DHCP Client.1099gitlab # [ 13.833680] systemd[1]: Reached target Network is Online.1100gitlab # [ 41.436934] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[923]: W, [2026-08-23T16:52:20.523618 #923] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1101gitlab # [ 43.518065] postgres[1318]: [1318] ERROR: relation "feature_gates" does not exist at character 5231102gitlab # [ 43.519255] postgres[1318]: [1318] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1103gitlab # [ 43.519875] postgres[1318]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1104gitlab # [ 43.521326] postgres[1318]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1105gitlab # [ 43.522837] postgres[1318]: attidentity AS identity,1106gitlab # [ 43.524394] postgres[1318]: attgenerated as attgenerated1107gitlab # [ 43.525949] postgres[1318]: FROM pg_attribute a1108gitlab # [ 43.527445] postgres[1318]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1109gitlab # [ 43.528561] postgres[1318]: LEFT JOIN pg_type t ON a.atttypid = t.oid1110gitlab # [ 43.530037] postgres[1318]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1111gitlab # [ 43.531478] postgres[1318]: WHERE a.attrelid = '"feature_gates"'::regclass1112gitlab # [ 43.532975] postgres[1318]: AND a.attnum > 0 AND NOT a.attisdropped1113gitlab # [ 43.534847] postgres[1318]: ORDER BY a.attnum1114gitlab # [ 43.536321] postgres[1318]:1115gitlab # [ 46.936847] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 46.938427] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 48.509743] gitlab-workhorse[826]: time="2026-08-23T16:52:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 58.520119] gitlab-workhorse[826]: time="2026-08-23T16:52:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 62.745172] postgres[1426]: [1426] ERROR: relation "table_without_models" does not exist1120gitlab # [ 62.747441] postgres[1426]: [1426] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 68.530732] gitlab-workhorse[826]: time="2026-08-23T16:52:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 74.570489] systemd[1]: Finished gitlab-db-config.service.1123gitlab # [ 74.576192] systemd[1]: Started gitlab-sidekiq.service.1124gitlab # [ 74.578554] systemd[1]: Starting gitlab.service...1125gitlab # [ 74.932431] bundle[1593]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1126gitlab # [ 74.933859] bundle[1593]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1127gitlab # [ 74.937448] bundle[1593]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1128gitlab # [ 77.721550] sidekiq-cluster[1592]: {"severity":"INFO","time":"2026-08-23T16:52:56.791Z","message":"Starting cluster with 1 processes"}1129gitlab # [ 77.984155] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.048Z","pid":1593,"message":"* Enabling systemd notification integration"}1130gitlab # [ 77.984531] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.070Z","pid":1593,"message":"Puma starting in cluster mode..."}1131gitlab # [ 77.985081] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.070Z","pid":1593,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1132gitlab # [ 77.985608] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.070Z","pid":1593,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1133gitlab # [ 77.985953] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.071Z","pid":1593,"message":"* Min threads: 0"}1134gitlab # [ 77.986545] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.071Z","pid":1593,"message":"* Max threads: 4"}1135gitlab # [ 77.986958] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.071Z","pid":1593,"message":"* Environment: production"}1136gitlab # [ 77.987543] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.071Z","pid":1593,"message":"* Master PID: 1593"}1137gitlab # [ 77.987958] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.071Z","pid":1593,"message":"* Workers: 2"}1138gitlab # [ 77.988563] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.071Z","pid":1593,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1139gitlab # [ 77.988958] bundle[1593]: {"timestamp":"2026-08-23T16:52:57.071Z","pid":1593,"message":"* Preloading application"}1140gitlab # [ 78.540060] gitlab-workhorse[826]: time="2026-08-23T16:52:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 88.550186] gitlab-workhorse[826]: time="2026-08-23T16:53:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 98.560581] gitlab-workhorse[826]: time="2026-08-23T16:53:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 101.747389] bundle[1593]: W, [2026-08-23T16:53:20.834163 #1593] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 103.049928] sidekiq-cluster[1623]: 2026-08-23T16:53:22.136Z pid=1623 tid=wlb INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1623, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431104000}1145gitlab # [ 103.225145] sidekiq-cluster[1623]: W, [2026-08-23T16:53:22.312145 #1623] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 103.264289] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:22.351Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1147gitlab # [ 105.143786] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.230Z","message":"GitLab reliable fetch activated!"}1148gitlab # [ 105.144622] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.230Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1149gitlab # [ 105.165624] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.252Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1150gitlab # [ 105.167904] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.255Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1151gitlab # [ 105.170400] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.257Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1152gitlab # [ 105.172707] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.259Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1153gitlab # [ 105.175100] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.262Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1154gitlab # [ 105.177424] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.264Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1155gitlab # [ 105.179600] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.266Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1156gitlab # [ 105.181446] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.268Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1157gitlab # [ 105.183310] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.270Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1158gitlab # [ 105.185354] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.272Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1159gitlab # [ 105.187216] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.274Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1160gitlab # [ 105.189557] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.276Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1161gitlab # [ 105.191464] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.278Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1162gitlab # [ 105.193375] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.280Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1163gitlab # [ 105.195596] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.282Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1164gitlab # [ 105.199625] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.286Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1165gitlab # [ 105.201854] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.288Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1166gitlab # [ 105.204174] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.291Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1167gitlab # [ 105.206313] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.293Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1168gitlab # [ 105.208410] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.295Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1169gitlab # [ 105.210674] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.297Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1170gitlab # [ 105.212465] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.299Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1171gitlab # [ 105.214437] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.301Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1172gitlab # [ 105.216205] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.303Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1173gitlab # [ 105.218045] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.305Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1174gitlab # [ 105.220073] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.307Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1175gitlab # [ 105.222064] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.309Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1176gitlab # [ 105.224085] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.311Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1177gitlab # [ 105.225993] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.313Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1178gitlab # [ 105.228090] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.315Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1179gitlab # [ 105.229815] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.316Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1180gitlab # [ 105.232054] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.319Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1181gitlab # [ 105.234071] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.321Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1182gitlab # [ 105.236069] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.323Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1183gitlab # [ 105.237706] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.324Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1184gitlab # [ 105.239399] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.326Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1185gitlab # [ 105.241326] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.328Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1186gitlab # [ 105.242998] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.330Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1187gitlab # [ 105.244760] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.331Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1188gitlab # [ 105.246319] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.333Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1189gitlab # [ 105.248110] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.335Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1190gitlab # [ 105.249742] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.336Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1191gitlab # [ 105.251395] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.338Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1192gitlab # [ 105.253264] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.340Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1193gitlab # [ 105.255395] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.342Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1194gitlab # [ 105.257083] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.344Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1195gitlab # [ 105.258699] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.345Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1196gitlab # [ 105.260727] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.347Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1197gitlab # [ 105.262994] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.350Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1198gitlab # [ 105.264781] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.351Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1199gitlab # [ 105.266655] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.353Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1200gitlab # [ 105.268772] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.355Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1201gitlab # [ 105.277782] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.364Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1202gitlab # [ 105.280749] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.367Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1203gitlab # [ 105.283289] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.370Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1204gitlab # [ 105.285897] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.373Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1205gitlab # [ 105.288324] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.375Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1206gitlab # [ 105.291191] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.378Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1207gitlab # [ 105.293492] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.380Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1208gitlab # [ 105.295912] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.383Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1209gitlab # [ 105.298027] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.385Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1210gitlab # [ 105.300191] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.387Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1211gitlab # [ 105.302942] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.390Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1212gitlab # [ 105.305753] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.392Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1213gitlab # [ 105.308651] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.395Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1214gitlab # [ 105.343352] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.429Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1215gitlab # [ 105.345646] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.432Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1216gitlab # [ 105.347531] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.434Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1217gitlab # [ 105.349643] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.436Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1218gitlab # [ 105.351640] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.438Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1219gitlab # [ 105.354089] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.441Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1220gitlab # [ 105.356173] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.443Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1221gitlab # [ 105.358802] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.445Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1222gitlab # [ 105.360605] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.447Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1223gitlab # [ 105.362891] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.450Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1224gitlab # [ 105.364929] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.452Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1225gitlab # [ 105.367416] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.454Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1226gitlab # [ 105.369229] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.456Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1227gitlab # [ 105.371629] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.458Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1228gitlab # [ 105.373402] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.460Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1229gitlab # [ 105.375394] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.462Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1230gitlab # [ 105.377726] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.464Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1231gitlab # [ 105.380096] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.467Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1232gitlab # [ 105.382447] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.469Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1233gitlab # [ 105.384428] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.471Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1234gitlab # [ 105.386808] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.473Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1235gitlab # [ 105.389355] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.476Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1236gitlab # [ 105.391512] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.478Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1237gitlab # [ 105.393345] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.480Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1238gitlab # [ 105.395991] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.483Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1239gitlab # [ 105.397903] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.485Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1240gitlab # [ 105.400328] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.487Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1241gitlab # [ 105.402082] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.489Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1242gitlab # [ 105.404617] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.491Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1243gitlab # [ 105.406852] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.494Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1244gitlab # [ 105.409690] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.496Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1245gitlab # [ 105.411487] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.498Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1246gitlab # [ 105.413844] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.501Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1247gitlab # [ 105.423235] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.510Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1248gitlab # [ 105.425239] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.512Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1249gitlab # [ 105.427243] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.514Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1250gitlab # [ 105.430142] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.517Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1251gitlab # [ 105.432516] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.519Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1252gitlab # [ 105.435236] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.522Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1253gitlab # [ 105.437611] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.524Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1254gitlab # [ 105.439690] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.526Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1255gitlab # [ 105.441455] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.528Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1256gitlab # [ 105.444438] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.531Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1257gitlab # [ 105.446275] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:24.533Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1258gitlab # [ 108.561836] gitlab-workhorse[826]: time="2026-08-23T16:53:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1259gitlab # [ 108.863580] sidekiq-cluster[1623]: InitializerConnections Query: SET client_min_messages TO 'warning'1260gitlab # [ 108.864825] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1261gitlab # [ 108.865940] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1262gitlab # [ 108.867081] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1263gitlab # [ 108.867435] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1264gitlab # [ 108.868595] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1265gitlab # [ 108.869776] sidekiq-cluster[1623]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1266gitlab # [ 108.906477] sidekiq-cluster[1623]: InitializerConnections Query: SET standard_conforming_strings = on1267gitlab # [ 108.907204] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1268gitlab # [ 108.908904] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1269gitlab # [ 108.910077] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1270gitlab # [ 108.910822] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1271gitlab # [ 108.911959] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1272gitlab # [ 108.913472] sidekiq-cluster[1623]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1273gitlab # [ 108.938084] sidekiq-cluster[1623]: InitializerConnections Query: SET intervalstyle = iso_86011274gitlab # [ 108.939100] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1275gitlab # [ 108.939852] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1276gitlab # [ 108.940958] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1277gitlab # [ 108.942140] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1278gitlab # [ 108.942950] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1279gitlab # [ 108.944104] sidekiq-cluster[1623]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1280gitlab # [ 108.966746] sidekiq-cluster[1623]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1281gitlab # [ 108.967733] sidekiq-cluster[1623]: FROM pg_type as t1282gitlab # [ 108.968445] sidekiq-cluster[1623]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1283gitlab # [ 108.969164] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1284gitlab # [ 108.969838] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1285gitlab # [ 108.970594] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1286gitlab # [ 108.971265] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1287gitlab # [ 108.971966] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1288gitlab # [ 108.972590] sidekiq-cluster[1623]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1289gitlab # [ 108.973296] sidekiq-cluster[1623]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1290gitlab # [ 108.973998] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1291gitlab # [ 108.974751] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1292gitlab # [ 108.975531] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1293gitlab # [ 108.976172] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1294gitlab # [ 108.976772] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1295gitlab # [ 108.977545] sidekiq-cluster[1623]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1296gitlab # [ 108.978241] sidekiq-cluster[1623]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1297gitlab # [ 108.978955] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1298gitlab # [ 108.979716] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1299gitlab # [ 108.980412] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1300gitlab # [ 108.981067] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1301gitlab # [ 108.981666] sidekiq-cluster[1623]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1302gitlab # [ 108.982406] sidekiq-cluster[1623]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1303gitlab # [ 118.572497] gitlab-workhorse[826]: time="2026-08-23T16:53:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1304gitlab # [ 128.573067] gitlab-workhorse[826]: time="2026-08-23T16:53:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1305gitlab # [ 130.212914] postgres[2088]: [2088] ERROR: relation "table_without_models" does not exist1306gitlab # [ 130.213548] postgres[2088]: [2088] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1307gitlab # [ 130.958540] postgres[2108]: [2108] ERROR: relation "table_without_models" does not exist1308gitlab # [ 130.959590] postgres[2108]: [2108] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1309gitlab # [ 132.873796] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:51.960Z","message":"Booted Rails 7.2.3.1 application in production environment"}1310gitlab # [ 132.879043] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:51.965Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1311gitlab # [ 132.880767] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:51.965Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1312gitlab # [ 132.883369] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:51.965Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1313gitlab # [ 132.884345] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:51.970Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1314gitlab # [ 133.796567] bundle[1593]: {"timestamp":"2026-08-23T16:53:52.882Z","pid":1593,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1315gitlab # [ 133.797576] bundle[1593]: {"timestamp":"2026-08-23T16:53:52.882Z","pid":1593,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1316gitlab # [ 133.798444] bundle[1593]: {"timestamp":"2026-08-23T16:53:52.882Z","pid":1593,"message":"! #\u003cThread:0x000072e4fb40b2a0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1317gitlab # [ 133.799134] bundle[1593]: {"timestamp":"2026-08-23T16:53:52.883Z","pid":1593,"message":"! #\u003cThread:0x000072e4fb5e5918 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1318gitlab # [ 133.799770] bundle[1593]: {"timestamp":"2026-08-23T16:53:52.883Z","pid":1593,"message":"Use Ctrl-C to stop"}1319gitlab # [ 133.800553] bundle[1593]: {"timestamp":"2026-08-23T16:53:52.883Z","pid":1593,"message":"Sending status to systemd every 1.0 sec"}1320gitlab # [ 134.584627] bundle[1593]: {"timestamp":"2026-08-23T16:53:53.671Z","pid":1593,"message":"- Worker 0 (PID: 2174) booted in 0.74s, phase: 0"}1321gitlab # [ 134.622917] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:53.709Z","message":"Cleaning working queues"}1322gitlab # [ 134.625265] bundle[1593]: {"timestamp":"2026-08-23T16:53:53.712Z","pid":1593,"message":"- Worker 1 (PID: 2178) booted in 0.77s, phase: 0"}1323gitlab # [ 134.628403] systemd[1]: Started gitlab.service.1324gitlab # [ 134.629164] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:53.714Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"88c718ce53f389f7ae2e2128","created_at":"2026-08-23T16:52:53.243Z","trace_propagation_headers":{"sentry-trace":"2e3723ceaff845d3a9405630913ea60a-04dfaeff640a4eeb","baggage":"sentry-trace_id=2e3723ceaff845d3a9405630913ea60a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"5facc79cbfec5891b73da85ad37409e5","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T16:52:53.251Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-88c718ce53f389f7ae2e2128: start","job_status":"start","queue_duration_s":60.46251,"scheduling_latency_s":60.462565}1325gitlab # [ 134.639333] systemd[1]: Reached target Common target for all GitLab services..1326gitlab # [ 134.639794] systemd[1]: Starting setup-gitlab.service...1327gitlab # [ 134.650919] setup-gitlab-start[2216]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1328gitlab # [ 134.778153] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:53:53.864Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"88c718ce53f389f7ae2e2128","created_at":"2026-08-23T16:52:53.243Z","trace_propagation_headers":{"sentry-trace":"2e3723ceaff845d3a9405630913ea60a-04dfaeff640a4eeb","baggage":"sentry-trace_id=2e3723ceaff845d3a9405630913ea60a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"5facc79cbfec5891b73da85ad37409e5","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T16:52:53.251Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-88c718ce53f389f7ae2e2128: done: 0.152572 sec","job_status":"done","queue_duration_s":60.46251,"scheduling_latency_s":60.462565,"redis_calls":26,"redis_duration_s":0.005405999999999999,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002299,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00191,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.075459591,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.152572,"completed_at":"2026-08-23T16:53:53.864Z","load_balancing_strategy":"primary","db_duration_s":0.037473,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1329gitlab # [ 136.732352] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:53:55 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 20641330gitlab # [ 136.737801] setup-gitlab-start[2216]: + TOKEN=nixbot-test-token-of-20-chars1331gitlab # [ 136.739426] setup-gitlab-start[2216]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1332gitlab # [ 136.766101] runuser[2236]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1333gitlab # [ 137.133323] setup-gitlab-start[2237]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1334gitlab # [ 137.135430] setup-gitlab-start[2237]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1335gitlab # [ 137.137073] setup-gitlab-start[2237]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1336gitlab # [ 137.727791] setup-gitlab-start[2237]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1337gitlab # [ 137.729368] setup-gitlab-start[2237]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1338gitlab # [ 137.729932] setup-gitlab-start[2237]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1339gitlab # [ 149.362812] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.449Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6e8e66d68b5f056ba8ad5b6b","created_at":"2026-08-23T16:54:08.432Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"827495bc814597338d3116da525f23c7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.447Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6e8e66d68b5f056ba8ad5b6b: start","job_status":"start","queue_duration_s":0.001941,"scheduling_latency_s":0.001977}1340gitlab # [ 149.423369] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.510Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6e8e66d68b5f056ba8ad5b6b","created_at":"2026-08-23T16:54:08.432Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"827495bc814597338d3116da525f23c7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.447Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6e8e66d68b5f056ba8ad5b6b: done: 0.061248 sec","job_status":"done","queue_duration_s":0.001941,"scheduling_latency_s":0.001977,"redis_calls":16,"redis_duration_s":0.009802,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003512,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00182,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001092039,"duration_s":0.061248,"completed_at":"2026-08-23T16:54:08.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01936,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 149.471604] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.512Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a50c68cb06ba8518b77d28f7","created_at":"2026-08-23T16:54:08.453Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2de72ef29383d276d0644c53b5dd46bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T16:54:08.461Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a50c68cb06ba8518b77d28f7: start","job_status":"start","queue_duration_s":0.05046,"scheduling_latency_s":0.050482}1342gitlab # [ 149.484252] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.525Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1343gitlab # [ 149.487217] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.547Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a50c68cb06ba8518b77d28f7","created_at":"2026-08-23T16:54:08.453Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2de72ef29383d276d0644c53b5dd46bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T16:54:08.461Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a50c68cb06ba8518b77d28f7: done: 0.035631 sec","job_status":"done","queue_duration_s":0.05046,"scheduling_latency_s":0.050482,"redis_calls":10,"redis_duration_s":0.014005,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001076,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01204,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000468216,"duration_s":0.035631,"completed_at":"2026-08-23T16:54:08.547Z","load_balancing_strategy":"primary","db_duration_s":0.000462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 149.521523] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"c140f0bb6d3959f2e5388908","created_at":"2026-08-23T16:54:08.472Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcf673bfb391fe338c0b2585839ad52c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.498Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-c140f0bb6d3959f2e5388908: start","job_status":"start","queue_duration_s":0.053715,"scheduling_latency_s":0.053745}1345gitlab # [ 149.533833] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.591Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"c140f0bb6d3959f2e5388908","created_at":"2026-08-23T16:54:08.472Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcf673bfb391fe338c0b2585839ad52c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.498Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-c140f0bb6d3959f2e5388908: done: 0.039007 sec","job_status":"done","queue_duration_s":0.053715,"scheduling_latency_s":0.053745,"redis_calls":12,"redis_duration_s":0.014573,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000656,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004181,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000447543,"exclusive_lock_hold_duration_s":0.007501791000000001,"duration_s":0.039007,"completed_at":"2026-08-23T16:54:08.590Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 149.568726] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"57342a957e928ed611b77ecc","created_at":"2026-08-23T16:54:08.504Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cc2e90dcf8cd1c71d56d9554bfac651","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.515Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-57342a957e928ed611b77ecc: start","job_status":"start","queue_duration_s":0.084664,"scheduling_latency_s":0.084689}1347gitlab # [ 149.581422] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"57342a957e928ed611b77ecc","created_at":"2026-08-23T16:54:08.504Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cc2e90dcf8cd1c71d56d9554bfac651","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.515Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-57342a957e928ed611b77ecc: done: 0.063438 sec","job_status":"done","queue_duration_s":0.084664,"scheduling_latency_s":0.084689,"redis_calls":13,"redis_duration_s":0.010721,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00142,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006999,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002302,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.012547125999999999,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.063438,"completed_at":"2026-08-23T16:54:08.663Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019741,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1348gitlab # [ 149.582474] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"081876b25294cd7a68c47479","created_at":"2026-08-23T16:54:08.537Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a74f8d831492d7f7e7ed7f30a3677a7a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T16:54:08.550Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-081876b25294cd7a68c47479: start","job_status":"start","queue_duration_s":0.114648,"scheduling_latency_s":0.114667}1349gitlab # [ 149.635330] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"081876b25294cd7a68c47479","created_at":"2026-08-23T16:54:08.537Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a74f8d831492d7f7e7ed7f30a3677a7a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T16:54:08.550Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-081876b25294cd7a68c47479: done: 0.056785 sec","job_status":"done","queue_duration_s":0.114648,"scheduling_latency_s":0.114667,"redis_calls":10,"redis_duration_s":0.009271000000000001,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000631,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002945,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002020648,"duration_s":0.056785,"completed_at":"2026-08-23T16:54:08.722Z","load_balancing_strategy":"primary","db_duration_s":0.00795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 149.672382] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:08.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b314fb6280a5ad7e40ea1d39","created_at":"2026-08-23T16:54:08.565Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.571Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b314fb6280a5ad7e40ea1d39: start","job_status":"start","queue_duration_s":0.187223,"scheduling_latency_s":0.187263}1351gitlab # [ 149.935337] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.021Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b314fb6280a5ad7e40ea1d39","created_at":"2026-08-23T16:54:08.565Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.571Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b314fb6280a5ad7e40ea1d39: done: 0.262817 sec","job_status":"done","queue_duration_s":0.187223,"scheduling_latency_s":0.187263,"redis_calls":71,"redis_duration_s":0.085533,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.007857,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001647,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.071882,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.004147,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000461232,"duration_s":0.262817,"completed_at":"2026-08-23T16:54:09.021Z","load_balancing_strategy":"primary","db_duration_s":0.012046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 149.970754] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.023Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ec9b9ba4b31b90a44b8d7351","created_at":"2026-08-23T16:54:08.579Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60f9e5844b2ba9fab7a3658e79796024","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.585Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ec9b9ba4b31b90a44b8d7351: start","job_status":"start","queue_duration_s":0.438315,"scheduling_latency_s":0.438334}1353gitlab # [ 150.046309] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ec9b9ba4b31b90a44b8d7351","created_at":"2026-08-23T16:54:08.579Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60f9e5844b2ba9fab7a3658e79796024","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.585Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ec9b9ba4b31b90a44b8d7351: done: 0.108485 sec","job_status":"done","queue_duration_s":0.438315,"scheduling_latency_s":0.438334,"redis_calls":14,"redis_duration_s":0.004817,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002265,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001286,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001266,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000797587,"exclusive_lock_hold_duration_s":0.062756579,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.108485,"completed_at":"2026-08-23T16:54:09.132Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 150.087435] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.134Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"dedca1ebc96f61d515fd1208","created_at":"2026-08-23T16:54:08.599Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"766185772038d172430c7f3941c81ba7","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.618Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-dedca1ebc96f61d515fd1208: start","job_status":"start","queue_duration_s":0.516431,"scheduling_latency_s":0.516463}1355gitlab # [ 150.088132] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"dedca1ebc96f61d515fd1208","created_at":"2026-08-23T16:54:08.599Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"766185772038d172430c7f3941c81ba7","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.618Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-dedca1ebc96f61d515fd1208: done: 0.018634 sec","job_status":"done","queue_duration_s":0.516431,"scheduling_latency_s":0.516463,"redis_calls":12,"redis_duration_s":0.001787,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000345,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000252825,"duration_s":0.018634,"completed_at":"2026-08-23T16:54:09.153Z","load_balancing_strategy":"primary","db_duration_s":0.000394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 150.125817] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6620bf13dd66c63e6789a7da","created_at":"2026-08-23T16:54:08.631Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20ccb02096ef567c6ab76076e98429c1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.645Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6620bf13dd66c63e6789a7da: start","job_status":"start","queue_duration_s":0.509214,"scheduling_latency_s":0.509233}1357gitlab # [ 150.126665] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6620bf13dd66c63e6789a7da","created_at":"2026-08-23T16:54:08.631Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20ccb02096ef567c6ab76076e98429c1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.645Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6620bf13dd66c63e6789a7da: done: 0.021225 sec","job_status":"done","queue_duration_s":0.509214,"scheduling_latency_s":0.509233,"redis_calls":10,"redis_duration_s":0.001599,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000244724,"duration_s":0.021225,"completed_at":"2026-08-23T16:54:09.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 150.165294] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2eb6a11674e06b5447c4db8d","created_at":"2026-08-23T16:54:08.653Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30723c7d3f63b498896f418a16c8e0f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.662Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2eb6a11674e06b5447c4db8d: start","job_status":"start","queue_duration_s":0.514782,"scheduling_latency_s":0.5148}1359gitlab # [ 150.171450] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2eb6a11674e06b5447c4db8d","created_at":"2026-08-23T16:54:08.653Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30723c7d3f63b498896f418a16c8e0f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.662Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2eb6a11674e06b5447c4db8d: done: 0.016874 sec","job_status":"done","queue_duration_s":0.514782,"scheduling_latency_s":0.5148,"redis_calls":12,"redis_duration_s":0.001616,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000546,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218184,"duration_s":0.016874,"completed_at":"2026-08-23T16:54:09.193Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 150.216941] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.194Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"abfb91f39b5a941b7983d0e6","created_at":"2026-08-23T16:54:08.680Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84176236e2057a0dc9ee2191207c07a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.691Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-abfb91f39b5a941b7983d0e6: start","job_status":"start","queue_duration_s":0.503555,"scheduling_latency_s":0.503575}1361gitlab # [ 150.217578] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.205Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1362gitlab # [ 150.220413] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"abfb91f39b5a941b7983d0e6","created_at":"2026-08-23T16:54:08.680Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84176236e2057a0dc9ee2191207c07a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.691Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-abfb91f39b5a941b7983d0e6: done: 0.017994 sec","job_status":"done","queue_duration_s":0.503555,"scheduling_latency_s":0.503575,"redis_calls":10,"redis_duration_s":0.001979,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000698,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000311213,"duration_s":0.017994,"completed_at":"2026-08-23T16:54:09.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 150.261784] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"785324f8fe2da8c237d5edd5","created_at":"2026-08-23T16:54:08.709Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3e312df5ffc90af729938d65950556f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.721Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-785324f8fe2da8c237d5edd5: start","job_status":"start","queue_duration_s":0.493237,"scheduling_latency_s":0.493257}1364gitlab # [ 150.297552] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"785324f8fe2da8c237d5edd5","created_at":"2026-08-23T16:54:08.709Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3e312df5ffc90af729938d65950556f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.721Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-785324f8fe2da8c237d5edd5: done: 0.028154 sec","job_status":"done","queue_duration_s":0.493237,"scheduling_latency_s":0.493257,"redis_calls":10,"redis_duration_s":0.00149,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000260647,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.028154,"completed_at":"2026-08-23T16:54:09.242Z","load_balancing_strategy":"primary","db_duration_s":0.009729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 150.300753] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"83c8862d408c2a467649c61f","created_at":"2026-08-23T16:54:08.773Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0792cfbaa984f8ac7140be3ea020cfe5","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.788Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-83c8862d408c2a467649c61f: start","job_status":"start","queue_duration_s":0.454947,"scheduling_latency_s":0.454966}1366gitlab # [ 150.345032] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"83c8862d408c2a467649c61f","created_at":"2026-08-23T16:54:08.773Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0792cfbaa984f8ac7140be3ea020cfe5","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.788Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-83c8862d408c2a467649c61f: done: 0.023322 sec","job_status":"done","queue_duration_s":0.454947,"scheduling_latency_s":0.454966,"redis_calls":10,"redis_duration_s":0.001671,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002288,"duration_s":0.023322,"completed_at":"2026-08-23T16:54:09.266Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 150.347440] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7ae024783c55eb2816aaadf1","created_at":"2026-08-23T16:54:08.801Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47fd554a43ec5ac1b7a88c6ace2e3f3a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.813Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7ae024783c55eb2816aaadf1: start","job_status":"start","queue_duration_s":0.454445,"scheduling_latency_s":0.454461}1368gitlab # [ 150.359733] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7ae024783c55eb2816aaadf1","created_at":"2026-08-23T16:54:08.801Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47fd554a43ec5ac1b7a88c6ace2e3f3a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.813Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7ae024783c55eb2816aaadf1: done: 0.032013 sec","job_status":"done","queue_duration_s":0.454445,"scheduling_latency_s":0.454461,"redis_calls":12,"redis_duration_s":0.001783,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000634,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000451733,"exclusive_lock_hold_duration_s":0.0099711,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.032013,"completed_at":"2026-08-23T16:54:09.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011636,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 150.420568] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"667fcdb08931577b31096699","created_at":"2026-08-23T16:54:08.822Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5301904867c5ec0e0a4d39b2e4d74b75","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.834Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-667fcdb08931577b31096699: start","job_status":"start","queue_duration_s":0.466961,"scheduling_latency_s":0.466983}1370gitlab # [ 150.421193] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"667fcdb08931577b31096699","created_at":"2026-08-23T16:54:08.822Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5301904867c5ec0e0a4d39b2e4d74b75","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.834Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-667fcdb08931577b31096699: done: 0.014321 sec","job_status":"done","queue_duration_s":0.466961,"scheduling_latency_s":0.466983,"redis_calls":10,"redis_duration_s":0.001417,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000338,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000249473,"duration_s":0.014321,"completed_at":"2026-08-23T16:54:09.315Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000859,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 150.465858] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.316Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e4d37c7a8b2df1216497329b","created_at":"2026-08-23T16:54:08.853Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b78936580ee946fc8d6c43e857c4dbae","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.863Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e4d37c7a8b2df1216497329b: start","job_status":"start","queue_duration_s":0.453484,"scheduling_latency_s":0.453501}1372gitlab # [ 150.466617] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.333Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e4d37c7a8b2df1216497329b","created_at":"2026-08-23T16:54:08.853Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b78936580ee946fc8d6c43e857c4dbae","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.863Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e4d37c7a8b2df1216497329b: done: 0.016952 sec","job_status":"done","queue_duration_s":0.453484,"scheduling_latency_s":0.453501,"redis_calls":12,"redis_duration_s":0.001686,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000341105,"exclusive_lock_hold_duration_s":0.002401144,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016952,"completed_at":"2026-08-23T16:54:09.333Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001151,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 150.522947] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"819e48e776bdb774fa14c35d","created_at":"2026-08-23T16:54:08.875Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f30185b9cd3d628d0e80b6d16ca78ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.884Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-819e48e776bdb774fa14c35d: start","job_status":"start","queue_duration_s":0.450151,"scheduling_latency_s":0.450169}1374gitlab # [ 150.523652] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.350Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"819e48e776bdb774fa14c35d","created_at":"2026-08-23T16:54:08.875Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f30185b9cd3d628d0e80b6d16ca78ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.884Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-819e48e776bdb774fa14c35d: done: 0.01506 sec","job_status":"done","queue_duration_s":0.450151,"scheduling_latency_s":0.450169,"redis_calls":12,"redis_duration_s":0.001707,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243607,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.01506,"completed_at":"2026-08-23T16:54:09.350Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000304,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 150.560683] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.351Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"907758ade122609533b4f31e","created_at":"2026-08-23T16:54:08.904Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0959ccf1fbdf16b5adc31c7846f66fd6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.914Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-907758ade122609533b4f31e: start","job_status":"start","queue_duration_s":0.436483,"scheduling_latency_s":0.436499}1376gitlab # [ 150.561567] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"907758ade122609533b4f31e","created_at":"2026-08-23T16:54:08.904Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0959ccf1fbdf16b5adc31c7846f66fd6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.914Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-907758ade122609533b4f31e: done: 0.151418 sec","job_status":"done","queue_duration_s":0.436483,"scheduling_latency_s":0.436499,"redis_calls":14,"redis_duration_s":0.002422,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000767,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000363734,"exclusive_lock_hold_duration_s":0.13424080400000002,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.151418,"completed_at":"2026-08-23T16:54:09.502Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050978,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 150.616087] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.504Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"461d12ab0148c0aa77647aca","created_at":"2026-08-23T16:54:08.924Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e676c5a37de3d6b794310c0398a37d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.933Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-461d12ab0148c0aa77647aca: start","job_status":"start","queue_duration_s":0.57098,"scheduling_latency_s":0.570996}1378gitlab # [ 150.616777] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.514Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1379gitlab # [ 150.617215] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.519Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"461d12ab0148c0aa77647aca","created_at":"2026-08-23T16:54:08.924Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e676c5a37de3d6b794310c0398a37d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.933Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-461d12ab0148c0aa77647aca: done: 0.015098 sec","job_status":"done","queue_duration_s":0.57098,"scheduling_latency_s":0.570996,"redis_calls":10,"redis_duration_s":0.001459,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362616,"duration_s":0.015098,"completed_at":"2026-08-23T16:54:09.519Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 150.659729] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4eb4e94291946d1af2aa061a","created_at":"2026-08-23T16:54:08.940Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5059e6f6f38db386a75175f4344aafe4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.949Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4eb4e94291946d1af2aa061a: start","job_status":"start","queue_duration_s":0.570827,"scheduling_latency_s":0.570839}1381gitlab # [ 150.660458] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.528Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1382gitlab # [ 150.660931] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4eb4e94291946d1af2aa061a","created_at":"2026-08-23T16:54:08.940Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5059e6f6f38db386a75175f4344aafe4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.949Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4eb4e94291946d1af2aa061a: done: 0.012868 sec","job_status":"done","queue_duration_s":0.570827,"scheduling_latency_s":0.570839,"redis_calls":10,"redis_duration_s":0.001333,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022433,"duration_s":0.012868,"completed_at":"2026-08-23T16:54:09.533Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 150.720750] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"369817ad4c9d308f25464f08","created_at":"2026-08-23T16:54:08.960Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f3ee4c9e2ea48c20df3cffa4ebf3ac6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.968Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-369817ad4c9d308f25464f08: start","job_status":"start","queue_duration_s":0.56646,"scheduling_latency_s":0.566474}1384gitlab # [ 150.721567] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"369817ad4c9d308f25464f08","created_at":"2026-08-23T16:54:08.960Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f3ee4c9e2ea48c20df3cffa4ebf3ac6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.968Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-369817ad4c9d308f25464f08: done: 0.235167 sec","job_status":"done","queue_duration_s":0.56646,"scheduling_latency_s":0.566474,"redis_calls":565,"redis_duration_s":0.066053,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.064937,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.183624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040033,"duration_s":0.235167,"completed_at":"2026-08-23T16:54:09.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 150.734925] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.771Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"564db26533b7986047685478","created_at":"2026-08-23T16:54:08.978Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.986Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-564db26533b7986047685478: start","job_status":"start","queue_duration_s":0.785105,"scheduling_latency_s":0.785121}1386gitlab # [ 150.773556] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"564db26533b7986047685478","created_at":"2026-08-23T16:54:08.978Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.986Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-564db26533b7986047685478: done: 0.025566 sec","job_status":"done","queue_duration_s":0.785105,"scheduling_latency_s":0.785121,"redis_calls":19,"redis_duration_s":0.00271,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000527,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00024,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001537,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000379378,"duration_s":0.025566,"completed_at":"2026-08-23T16:54:09.796Z","load_balancing_strategy":"primary","db_duration_s":0.001845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 150.809315] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9f2774275332351bc2345ed9","created_at":"2026-08-23T16:54:08.992Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3cd3740980187f2e8961859d5fc0606","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.999Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9f2774275332351bc2345ed9: start","job_status":"start","queue_duration_s":0.798447,"scheduling_latency_s":0.798463}1388gitlab # [ 150.809910] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.805Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1389gitlab # [ 150.810392] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9f2774275332351bc2345ed9","created_at":"2026-08-23T16:54:08.992Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3cd3740980187f2e8961859d5fc0606","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:08.999Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9f2774275332351bc2345ed9: done: 0.013075 sec","job_status":"done","queue_duration_s":0.798447,"scheduling_latency_s":0.798463,"redis_calls":10,"redis_duration_s":0.001546,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022461,"duration_s":0.013075,"completed_at":"2026-08-23T16:54:09.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 150.851752] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c637e830e16a4e45f5712dd2","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c637e830e16a4e45f5712dd2: start","job_status":"start","queue_duration_s":0.805836,"scheduling_latency_s":0.805851}1391gitlab # [ 150.852633] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c637e830e16a4e45f5712dd2","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c637e830e16a4e45f5712dd2: done: 0.016332 sec","job_status":"done","queue_duration_s":0.805836,"scheduling_latency_s":0.805851,"redis_calls":16,"redis_duration_s":0.002257,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001374,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000371835,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016332,"completed_at":"2026-08-23T16:54:09.828Z","load_balancing_strategy":"primary","db_duration_s":0.001421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 150.893526] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b226806111a0bc9ac1210248","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b226806111a0bc9ac1210248: start","job_status":"start","queue_duration_s":0.823245,"scheduling_latency_s":0.823259}1393gitlab # [ 150.894246] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b226806111a0bc9ac1210248","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b226806111a0bc9ac1210248: done: 0.01028 sec","job_status":"done","queue_duration_s":0.823245,"scheduling_latency_s":0.823259,"redis_calls":13,"redis_duration_s":0.001606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01028,"completed_at":"2026-08-23T16:54:09.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 150.931622] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f01b81da409198346e2d886f","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f01b81da409198346e2d886f: start","job_status":"start","queue_duration_s":0.834494,"scheduling_latency_s":0.834508}1395gitlab # [ 150.932419] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f01b81da409198346e2d886f","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f01b81da409198346e2d886f: done: 0.009888 sec","job_status":"done","queue_duration_s":0.834494,"scheduling_latency_s":0.834508,"redis_calls":13,"redis_duration_s":0.00164,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009888,"completed_at":"2026-08-23T16:54:09.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 150.967541] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fe2dea933ea3d4a0cbbe45e","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fe2dea933ea3d4a0cbbe45e: start","job_status":"start","queue_duration_s":0.845408,"scheduling_latency_s":0.845422}1397gitlab # [ 150.968132] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fe2dea933ea3d4a0cbbe45e","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fe2dea933ea3d4a0cbbe45e: done: 0.010096 sec","job_status":"done","queue_duration_s":0.845408,"scheduling_latency_s":0.845422,"redis_calls":13,"redis_duration_s":0.001729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010096,"completed_at":"2026-08-23T16:54:09.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 151.005034] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fae1adf44ede379efe8b60cf","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fae1adf44ede379efe8b60cf: start","job_status":"start","queue_duration_s":0.856397,"scheduling_latency_s":0.856411}1399gitlab # [ 151.005879] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fae1adf44ede379efe8b60cf","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fae1adf44ede379efe8b60cf: done: 0.010347 sec","job_status":"done","queue_duration_s":0.856397,"scheduling_latency_s":0.856411,"redis_calls":13,"redis_duration_s":0.001638,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010347,"completed_at":"2026-08-23T16:54:09.872Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 151.046306] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce8fcc13fd04f7dd67e5d052","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce8fcc13fd04f7dd67e5d052: start","job_status":"start","queue_duration_s":0.867612,"scheduling_latency_s":0.867626}1401gitlab # [ 151.047165] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce8fcc13fd04f7dd67e5d052","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce8fcc13fd04f7dd67e5d052: done: 0.010033 sec","job_status":"done","queue_duration_s":0.867612,"scheduling_latency_s":0.867626,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010033,"completed_at":"2026-08-23T16:54:09.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 151.082559] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cea56ea3265fadaa7a8d460","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cea56ea3265fadaa7a8d460: start","job_status":"start","queue_duration_s":0.878519,"scheduling_latency_s":0.878531}1403gitlab # [ 151.088663] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cea56ea3265fadaa7a8d460","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cea56ea3265fadaa7a8d460: done: 0.010287 sec","job_status":"done","queue_duration_s":0.878519,"scheduling_latency_s":0.878531,"redis_calls":13,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010287,"completed_at":"2026-08-23T16:54:09.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 151.130750] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ed492411baec9688dc7639e","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ed492411baec9688dc7639e: start","job_status":"start","queue_duration_s":0.889669,"scheduling_latency_s":0.889684}1405gitlab # [ 151.131597] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ed492411baec9688dc7639e","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ed492411baec9688dc7639e: done: 0.010193 sec","job_status":"done","queue_duration_s":0.889669,"scheduling_latency_s":0.889684,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010193,"completed_at":"2026-08-23T16:54:09.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 151.182479] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da7e82d0da6e2c16780d073","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da7e82d0da6e2c16780d073: start","job_status":"start","queue_duration_s":0.90086,"scheduling_latency_s":0.900874}1407gitlab # [ 151.183206] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da7e82d0da6e2c16780d073","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da7e82d0da6e2c16780d073: done: 0.009925 sec","job_status":"done","queue_duration_s":0.90086,"scheduling_latency_s":0.900874,"redis_calls":13,"redis_duration_s":0.001663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009925,"completed_at":"2026-08-23T16:54:09.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 151.235317] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43be266e922f12e2522327f4","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43be266e922f12e2522327f4: start","job_status":"start","queue_duration_s":0.911835,"scheduling_latency_s":0.91185}1409gitlab # [ 151.236060] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43be266e922f12e2522327f4","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43be266e922f12e2522327f4: done: 0.010175 sec","job_status":"done","queue_duration_s":0.911835,"scheduling_latency_s":0.91185,"redis_calls":13,"redis_duration_s":0.001627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010175,"completed_at":"2026-08-23T16:54:09.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 151.281490] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75581d961962b6358cdf245b","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75581d961962b6358cdf245b: start","job_status":"start","queue_duration_s":0.923015,"scheduling_latency_s":0.923029}1411gitlab # [ 151.282219] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75581d961962b6358cdf245b","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75581d961962b6358cdf245b: done: 0.009968 sec","job_status":"done","queue_duration_s":0.923015,"scheduling_latency_s":0.923029,"redis_calls":13,"redis_duration_s":0.00164,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009968,"completed_at":"2026-08-23T16:54:09.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 151.288938] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e741adee0d07a7c387d4e4c5","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e741adee0d07a7c387d4e4c5: start","job_status":"start","queue_duration_s":0.934008,"scheduling_latency_s":0.934021}1413gitlab # [ 151.326980] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e741adee0d07a7c387d4e4c5","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e741adee0d07a7c387d4e4c5: done: 0.009993 sec","job_status":"done","queue_duration_s":0.934008,"scheduling_latency_s":0.934021,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009993,"completed_at":"2026-08-23T16:54:09.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 151.331580] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0cc8f72985e9f0c315baa6b","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0cc8f72985e9f0c315baa6b: start","job_status":"start","queue_duration_s":0.945027,"scheduling_latency_s":0.94504}1415gitlab # [ 151.342323] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0cc8f72985e9f0c315baa6b","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0cc8f72985e9f0c315baa6b: done: 0.010338 sec","job_status":"done","queue_duration_s":0.945027,"scheduling_latency_s":0.94504,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010338,"completed_at":"2026-08-23T16:54:09.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 151.385691] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89a239af7d22bea777eba6f1","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89a239af7d22bea777eba6f1: start","job_status":"start","queue_duration_s":0.956188,"scheduling_latency_s":0.956202}1417gitlab # [ 151.386450] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89a239af7d22bea777eba6f1","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89a239af7d22bea777eba6f1: done: 0.010223 sec","job_status":"done","queue_duration_s":0.956188,"scheduling_latency_s":0.956202,"redis_calls":13,"redis_duration_s":0.0018670000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001275,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010223,"completed_at":"2026-08-23T16:54:09.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 151.428432] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1be08984fafc4d8e8f6fbb10","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1be08984fafc4d8e8f6fbb10: start","job_status":"start","queue_duration_s":0.96727,"scheduling_latency_s":0.967284}1419gitlab # [ 151.428991] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1be08984fafc4d8e8f6fbb10","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1be08984fafc4d8e8f6fbb10: done: 0.01003 sec","job_status":"done","queue_duration_s":0.96727,"scheduling_latency_s":0.967284,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01003,"completed_at":"2026-08-23T16:54:09.983Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 151.465908] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eecef99153ddfb6907ac0f8","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eecef99153ddfb6907ac0f8: start","job_status":"start","queue_duration_s":0.97809,"scheduling_latency_s":0.978103}1421gitlab # [ 151.466602] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eecef99153ddfb6907ac0f8","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eecef99153ddfb6907ac0f8: done: 0.009969 sec","job_status":"done","queue_duration_s":0.97809,"scheduling_latency_s":0.978103,"redis_calls":13,"redis_duration_s":0.001764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009969,"completed_at":"2026-08-23T16:54:09.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 151.521881] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:09.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8266b8376bfa892286d161a5","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8266b8376bfa892286d161a5: start","job_status":"start","queue_duration_s":0.989059,"scheduling_latency_s":0.989073}1423gitlab # [ 151.522700] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8266b8376bfa892286d161a5","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8266b8376bfa892286d161a5: done: 0.010076 sec","job_status":"done","queue_duration_s":0.989059,"scheduling_latency_s":0.989073,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010076,"completed_at":"2026-08-23T16:54:10.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 151.572821] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c8b969ada7ea136b725dce","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c8b969ada7ea136b725dce: start","job_status":"start","queue_duration_s":1.000043,"scheduling_latency_s":1.000056}1425gitlab # [ 151.573611] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c8b969ada7ea136b725dce","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c8b969ada7ea136b725dce: done: 0.010057 sec","job_status":"done","queue_duration_s":1.000043,"scheduling_latency_s":1.000056,"redis_calls":13,"redis_duration_s":0.001647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010057,"completed_at":"2026-08-23T16:54:10.016Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 151.581666] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94ceba04478b4a67f8346e3b","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94ceba04478b4a67f8346e3b: start","job_status":"start","queue_duration_s":1.010944,"scheduling_latency_s":1.010958}1427gitlab # [ 151.625824] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94ceba04478b4a67f8346e3b","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94ceba04478b4a67f8346e3b: done: 0.00998 sec","job_status":"done","queue_duration_s":1.010944,"scheduling_latency_s":1.010958,"redis_calls":13,"redis_duration_s":0.0016330000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00998,"completed_at":"2026-08-23T16:54:10.026Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 151.626685] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ed9fdd1c34e12f9fe9f7ee4","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ed9fdd1c34e12f9fe9f7ee4: start","job_status":"start","queue_duration_s":1.021921,"scheduling_latency_s":1.021934}1429gitlab # [ 151.633157] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ed9fdd1c34e12f9fe9f7ee4","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ed9fdd1c34e12f9fe9f7ee4: done: 0.010284 sec","job_status":"done","queue_duration_s":1.021921,"scheduling_latency_s":1.021934,"redis_calls":13,"redis_duration_s":0.001779,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010284,"completed_at":"2026-08-23T16:54:10.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 151.678612] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffac81c0e1082809ef88ef1b","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffac81c0e1082809ef88ef1b: start","job_status":"start","queue_duration_s":1.033191,"scheduling_latency_s":1.033204}1431gitlab # [ 151.679309] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffac81c0e1082809ef88ef1b","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffac81c0e1082809ef88ef1b: done: 0.009891 sec","job_status":"done","queue_duration_s":1.033191,"scheduling_latency_s":1.033204,"redis_calls":13,"redis_duration_s":0.001673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009891,"completed_at":"2026-08-23T16:54:10.049Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 151.707559] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfade2a894e40dbcbd3ba246","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfade2a894e40dbcbd3ba246: start","job_status":"start","queue_duration_s":1.04408,"scheduling_latency_s":1.044093}1433gitlab # [ 151.750093] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfade2a894e40dbcbd3ba246","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfade2a894e40dbcbd3ba246: done: 0.009828 sec","job_status":"done","queue_duration_s":1.04408,"scheduling_latency_s":1.044093,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009828,"completed_at":"2026-08-23T16:54:10.059Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 151.750990] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"748c692ba36717fe3f63c72f","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-748c692ba36717fe3f63c72f: start","job_status":"start","queue_duration_s":1.054896,"scheduling_latency_s":1.05491}1435gitlab # [ 151.786796] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"748c692ba36717fe3f63c72f","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-748c692ba36717fe3f63c72f: done: 0.064646 sec","job_status":"done","queue_duration_s":1.054896,"scheduling_latency_s":1.05491,"redis_calls":13,"redis_duration_s":0.0017859999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.064646,"completed_at":"2026-08-23T16:54:10.125Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 151.790036] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aaee069505e7286f0a25539","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aaee069505e7286f0a25539: start","job_status":"start","queue_duration_s":1.120593,"scheduling_latency_s":1.120611}1437gitlab # [ 151.825194] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aaee069505e7286f0a25539","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aaee069505e7286f0a25539: done: 0.009502 sec","job_status":"done","queue_duration_s":1.120593,"scheduling_latency_s":1.120611,"redis_calls":13,"redis_duration_s":0.001629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009502,"completed_at":"2026-08-23T16:54:10.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 151.831188] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a69e6ce739d099962dee326e","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a69e6ce739d099962dee326e: start","job_status":"start","queue_duration_s":1.13096,"scheduling_latency_s":1.130973}1439gitlab # [ 151.865889] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a69e6ce739d099962dee326e","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a69e6ce739d099962dee326e: done: 0.009491 sec","job_status":"done","queue_duration_s":1.13096,"scheduling_latency_s":1.130973,"redis_calls":13,"redis_duration_s":0.001706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009491,"completed_at":"2026-08-23T16:54:10.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 151.872650] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd93d25cbbd6a0be26308a28","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd93d25cbbd6a0be26308a28: start","job_status":"start","queue_duration_s":1.141383,"scheduling_latency_s":1.141397}1441gitlab # [ 151.882897] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd93d25cbbd6a0be26308a28","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd93d25cbbd6a0be26308a28: done: 0.009395 sec","job_status":"done","queue_duration_s":1.141383,"scheduling_latency_s":1.141397,"redis_calls":13,"redis_duration_s":0.00166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009395,"completed_at":"2026-08-23T16:54:10.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 151.928964] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb01400f25788baf810d11b6","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb01400f25788baf810d11b6: start","job_status":"start","queue_duration_s":1.151686,"scheduling_latency_s":1.151699}1443gitlab # [ 151.929694] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb01400f25788baf810d11b6","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb01400f25788baf810d11b6: done: 0.009816 sec","job_status":"done","queue_duration_s":1.151686,"scheduling_latency_s":1.151699,"redis_calls":13,"redis_duration_s":0.001647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009816,"completed_at":"2026-08-23T16:54:10.167Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 151.971673] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c1acabcdd6cd7da27ea8918","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c1acabcdd6cd7da27ea8918: start","job_status":"start","queue_duration_s":1.162701,"scheduling_latency_s":1.162715}1445gitlab # [ 151.972547] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c1acabcdd6cd7da27ea8918","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c1acabcdd6cd7da27ea8918: done: 0.009434 sec","job_status":"done","queue_duration_s":1.162701,"scheduling_latency_s":1.162715,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009434,"completed_at":"2026-08-23T16:54:10.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 151.997730] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd5c63dfce975d013f737b02","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd5c63dfce975d013f737b02: start","job_status":"start","queue_duration_s":1.172959,"scheduling_latency_s":1.172972}1447gitlab # [ 152.008250] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd5c63dfce975d013f737b02","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd5c63dfce975d013f737b02: done: 0.009567 sec","job_status":"done","queue_duration_s":1.172959,"scheduling_latency_s":1.172972,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009567,"completed_at":"2026-08-23T16:54:10.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 152.047711] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3108bbf6c01ab968918f93b0","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3108bbf6c01ab968918f93b0: start","job_status":"start","queue_duration_s":1.183393,"scheduling_latency_s":1.183407}1449gitlab # [ 152.050986] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3108bbf6c01ab968918f93b0","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3108bbf6c01ab968918f93b0: done: 0.009395 sec","job_status":"done","queue_duration_s":1.183393,"scheduling_latency_s":1.183407,"redis_calls":13,"redis_duration_s":0.001619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009395,"completed_at":"2026-08-23T16:54:10.198Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 152.097893] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fec125c011680ac2d41557d1","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fec125c011680ac2d41557d1: start","job_status":"start","queue_duration_s":1.193627,"scheduling_latency_s":1.193639}1451gitlab # [ 152.098566] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fec125c011680ac2d41557d1","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fec125c011680ac2d41557d1: done: 0.009722 sec","job_status":"done","queue_duration_s":1.193627,"scheduling_latency_s":1.193639,"redis_calls":13,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009722,"completed_at":"2026-08-23T16:54:10.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 152.134921] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"816bf9d96bb0c3ff54ff2930","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-816bf9d96bb0c3ff54ff2930: start","job_status":"start","queue_duration_s":1.204178,"scheduling_latency_s":1.204192}1453gitlab # [ 152.135724] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"816bf9d96bb0c3ff54ff2930","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-816bf9d96bb0c3ff54ff2930: done: 0.009473 sec","job_status":"done","queue_duration_s":1.204178,"scheduling_latency_s":1.204192,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009473,"completed_at":"2026-08-23T16:54:10.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 152.188487] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8d115699edff42e20c0bb27","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8d115699edff42e20c0bb27: start","job_status":"start","queue_duration_s":1.214514,"scheduling_latency_s":1.214528}1455gitlab # [ 152.189162] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8d115699edff42e20c0bb27","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8d115699edff42e20c0bb27: done: 0.009403 sec","job_status":"done","queue_duration_s":1.214514,"scheduling_latency_s":1.214528,"redis_calls":13,"redis_duration_s":0.001646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009403,"completed_at":"2026-08-23T16:54:10.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 152.205046] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e64e44a1eec2ac22790958a2","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e64e44a1eec2ac22790958a2: start","job_status":"start","queue_duration_s":1.224879,"scheduling_latency_s":1.224893}1457gitlab # [ 152.215047] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e64e44a1eec2ac22790958a2","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e64e44a1eec2ac22790958a2: done: 0.009517 sec","job_status":"done","queue_duration_s":1.224879,"scheduling_latency_s":1.224893,"redis_calls":13,"redis_duration_s":0.0016060000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009517,"completed_at":"2026-08-23T16:54:10.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 152.262157] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8b64011c5b1738a2db9f8ed","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8b64011c5b1738a2db9f8ed: start","job_status":"start","queue_duration_s":1.235617,"scheduling_latency_s":1.235629}1459gitlab # [ 152.262534] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8b64011c5b1738a2db9f8ed","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8b64011c5b1738a2db9f8ed: done: 0.0094 sec","job_status":"done","queue_duration_s":1.235617,"scheduling_latency_s":1.235629,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0094,"completed_at":"2026-08-23T16:54:10.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 152.300724] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"364858a22000576696608143","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-364858a22000576696608143: start","job_status":"start","queue_duration_s":1.245871,"scheduling_latency_s":1.245885}1461gitlab # [ 152.301523] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"364858a22000576696608143","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-364858a22000576696608143: done: 0.009553 sec","job_status":"done","queue_duration_s":1.245871,"scheduling_latency_s":1.245885,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009553,"completed_at":"2026-08-23T16:54:10.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 152.336173] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4f51aeb103175eeff90c926","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4f51aeb103175eeff90c926: start","job_status":"start","queue_duration_s":1.256259,"scheduling_latency_s":1.256273}1463gitlab # [ 152.337461] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4f51aeb103175eeff90c926","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4f51aeb103175eeff90c926: done: 0.009629 sec","job_status":"done","queue_duration_s":1.256259,"scheduling_latency_s":1.256273,"redis_calls":13,"redis_duration_s":0.00208,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001558,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009629,"completed_at":"2026-08-23T16:54:10.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 152.375588] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b59fe714a1aaee420481a298","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b59fe714a1aaee420481a298: start","job_status":"start","queue_duration_s":1.266768,"scheduling_latency_s":1.266782}1465gitlab # [ 152.377873] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b59fe714a1aaee420481a298","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b59fe714a1aaee420481a298: done: 0.009431 sec","job_status":"done","queue_duration_s":1.266768,"scheduling_latency_s":1.266782,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009431,"completed_at":"2026-08-23T16:54:10.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 152.412528] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e78a60be6d1935f812382d76","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e78a60be6d1935f812382d76: start","job_status":"start","queue_duration_s":1.277551,"scheduling_latency_s":1.277563}1467gitlab # [ 152.418501] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e78a60be6d1935f812382d76","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e78a60be6d1935f812382d76: done: 0.009387 sec","job_status":"done","queue_duration_s":1.277551,"scheduling_latency_s":1.277563,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009387,"completed_at":"2026-08-23T16:54:10.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 152.460028] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b9ee07a527d08fac4832dbc","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b9ee07a527d08fac4832dbc: start","job_status":"start","queue_duration_s":1.287784,"scheduling_latency_s":1.287797}1469gitlab # [ 152.460643] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b9ee07a527d08fac4832dbc","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b9ee07a527d08fac4832dbc: done: 0.009435 sec","job_status":"done","queue_duration_s":1.287784,"scheduling_latency_s":1.287797,"redis_calls":13,"redis_duration_s":0.00159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009435,"completed_at":"2026-08-23T16:54:10.303Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 152.490653] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36f2507b3cede334a51684bc","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36f2507b3cede334a51684bc: start","job_status":"start","queue_duration_s":1.298052,"scheduling_latency_s":1.298065}1471gitlab # [ 152.533527] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36f2507b3cede334a51684bc","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36f2507b3cede334a51684bc: done: 0.009503 sec","job_status":"done","queue_duration_s":1.298052,"scheduling_latency_s":1.298065,"redis_calls":13,"redis_duration_s":0.0016560000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009503,"completed_at":"2026-08-23T16:54:10.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 152.534569] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6f24e8b7393c4eadbe6a636","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6f24e8b7393c4eadbe6a636: start","job_status":"start","queue_duration_s":1.308406,"scheduling_latency_s":1.30842}1473gitlab # [ 152.572558] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6f24e8b7393c4eadbe6a636","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6f24e8b7393c4eadbe6a636: done: 0.009864 sec","job_status":"done","queue_duration_s":1.308406,"scheduling_latency_s":1.30842,"redis_calls":13,"redis_duration_s":0.001712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009864,"completed_at":"2026-08-23T16:54:10.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 152.573573] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b1b6af22993306ae1dd76ba","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b1b6af22993306ae1dd76ba: start","job_status":"start","queue_duration_s":1.319101,"scheduling_latency_s":1.319115}1475gitlab # [ 152.582234] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b1b6af22993306ae1dd76ba","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b1b6af22993306ae1dd76ba: done: 0.009592 sec","job_status":"done","queue_duration_s":1.319101,"scheduling_latency_s":1.319115,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009592,"completed_at":"2026-08-23T16:54:10.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 152.624145] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1e227095000d96735ebcfb6","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1e227095000d96735ebcfb6: start","job_status":"start","queue_duration_s":1.329555,"scheduling_latency_s":1.329569}1477gitlab # [ 152.624813] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1e227095000d96735ebcfb6","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1e227095000d96735ebcfb6: done: 0.009593 sec","job_status":"done","queue_duration_s":1.329555,"scheduling_latency_s":1.329569,"redis_calls":13,"redis_duration_s":0.0015789999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009593,"completed_at":"2026-08-23T16:54:10.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 152.678427] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8995aa5197866560f411a018","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8995aa5197866560f411a018: start","job_status":"start","queue_duration_s":1.340005,"scheduling_latency_s":1.340019}1479gitlab # [ 152.679198] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8995aa5197866560f411a018","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8995aa5197866560f411a018: done: 0.009665 sec","job_status":"done","queue_duration_s":1.340005,"scheduling_latency_s":1.340019,"redis_calls":13,"redis_duration_s":0.0016489999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009665,"completed_at":"2026-08-23T16:54:10.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 152.695734] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3217ce9dbe2723f8206dbbaf","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3217ce9dbe2723f8206dbbaf: start","job_status":"start","queue_duration_s":1.350542,"scheduling_latency_s":1.350555}1481gitlab # [ 152.705783] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3217ce9dbe2723f8206dbbaf","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3217ce9dbe2723f8206dbbaf: done: 0.009431 sec","job_status":"done","queue_duration_s":1.350542,"scheduling_latency_s":1.350555,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009431,"completed_at":"2026-08-23T16:54:10.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 152.755909] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3ce644a5142141ed68fc043","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3ce644a5142141ed68fc043: start","job_status":"start","queue_duration_s":1.361245,"scheduling_latency_s":1.361258}1483gitlab # [ 152.756554] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3ce644a5142141ed68fc043","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3ce644a5142141ed68fc043: done: 0.009779 sec","job_status":"done","queue_duration_s":1.361245,"scheduling_latency_s":1.361258,"redis_calls":13,"redis_duration_s":0.001635,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009779,"completed_at":"2026-08-23T16:54:10.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 152.778507] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c49581413d88b8d8825cb697","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c49581413d88b8d8825cb697: start","job_status":"start","queue_duration_s":1.371846,"scheduling_latency_s":1.371859}1485gitlab # [ 152.815759] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c49581413d88b8d8825cb697","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c49581413d88b8d8825cb697: done: 0.009595 sec","job_status":"done","queue_duration_s":1.371846,"scheduling_latency_s":1.371859,"redis_calls":13,"redis_duration_s":0.001633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009595,"completed_at":"2026-08-23T16:54:10.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 152.819428] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5be1535866caef70f02f1c86","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5be1535866caef70f02f1c86: start","job_status":"start","queue_duration_s":1.382288,"scheduling_latency_s":1.382301}1487gitlab # [ 152.862758] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5be1535866caef70f02f1c86","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5be1535866caef70f02f1c86: done: 0.009554 sec","job_status":"done","queue_duration_s":1.382288,"scheduling_latency_s":1.382301,"redis_calls":13,"redis_duration_s":0.0016220000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009554,"completed_at":"2026-08-23T16:54:10.397Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 152.863837] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cde9468852e11a478d5e5a0","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cde9468852e11a478d5e5a0: start","job_status":"start","queue_duration_s":1.392701,"scheduling_latency_s":1.392715}1489gitlab # [ 152.870468] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cde9468852e11a478d5e5a0","created_at":"2026-08-23T16:54:08.828Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-12c5e6d9ab8f434d","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7abf1780f9843ed714b7345165c97ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.006Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cde9468852e11a478d5e5a0: done: 0.00953 sec","job_status":"done","queue_duration_s":1.392701,"scheduling_latency_s":1.392715,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00953,"completed_at":"2026-08-23T16:54:10.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 152.906913] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.409Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ddfa0eb188dcf89f1e7dada4","created_at":"2026-08-23T16:54:09.007Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a2f447d1cf19ac92f040fb02cb70af2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T16:54:09.020Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ddfa0eb188dcf89f1e7dada4: start","job_status":"start","queue_duration_s":1.389109,"scheduling_latency_s":1.389122}1491gitlab # [ 152.941455] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.417Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1492gitlab # [ 152.942117] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.422Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ddfa0eb188dcf89f1e7dada4","created_at":"2026-08-23T16:54:09.007Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a2f447d1cf19ac92f040fb02cb70af2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T16:54:09.020Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ddfa0eb188dcf89f1e7dada4: done: 0.012977 sec","job_status":"done","queue_duration_s":1.389109,"scheduling_latency_s":1.389122,"redis_calls":10,"redis_duration_s":0.001323,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000249473,"duration_s":0.012977,"completed_at":"2026-08-23T16:54:10.422Z","load_balancing_strategy":"primary","db_duration_s":0.000744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 152.947578] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.423Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"7a4fe251adce66aa05b0de03","created_at":"2026-08-23T16:54:09.042Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3caed5b7969b9618f999682460b5452b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.056Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-7a4fe251adce66aa05b0de03: start","job_status":"start","queue_duration_s":1.367427,"scheduling_latency_s":1.36744}1494gitlab # [ 152.986099] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"7a4fe251adce66aa05b0de03","created_at":"2026-08-23T16:54:09.042Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-2137a317732b4ae1","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3caed5b7969b9618f999682460b5452b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.056Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-7a4fe251adce66aa05b0de03: done: 0.018453 sec","job_status":"done","queue_duration_s":1.367427,"scheduling_latency_s":1.36744,"redis_calls":12,"redis_duration_s":0.001692,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000643,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00031261,"exclusive_lock_hold_duration_s":0.0062239750000000005,"duration_s":0.018453,"completed_at":"2026-08-23T16:54:10.441Z","load_balancing_strategy":"primary","db_duration_s":0.003766,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 153.021522] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.442Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"018a1a6fa9cc353b32cf45c6","created_at":"2026-08-23T16:54:09.783Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-34d3685891a54c30","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.791Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-018a1a6fa9cc353b32cf45c6: start","job_status":"start","queue_duration_s":0.65162,"scheduling_latency_s":0.651634}1496gitlab # [ 153.022198] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.453Z","message":"No existing merge request to be cleaned up."}1497gitlab # [ 153.022655] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.460Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"018a1a6fa9cc353b32cf45c6","created_at":"2026-08-23T16:54:09.783Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-34d3685891a54c30","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.791Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-018a1a6fa9cc353b32cf45c6: done: 0.018087 sec","job_status":"done","queue_duration_s":0.65162,"scheduling_latency_s":0.651634,"redis_calls":13,"redis_duration_s":0.001679,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201702,"duration_s":0.018087,"completed_at":"2026-08-23T16:54:10.460Z","load_balancing_strategy":"primary","db_duration_s":0.002272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 153.057679] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.461Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b06910d6649bd084d96d98ce","created_at":"2026-08-23T16:54:09.783Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-34d3685891a54c30","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.791Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b06910d6649bd084d96d98ce: start","job_status":"start","queue_duration_s":0.670636,"scheduling_latency_s":0.67065}1499gitlab # [ 153.058218] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.468Z","message":"No existing merge request to be cleaned up."}1500gitlab # [ 153.058787] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.473Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b06910d6649bd084d96d98ce","created_at":"2026-08-23T16:54:09.783Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-34d3685891a54c30","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.791Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b06910d6649bd084d96d98ce: done: 0.011784 sec","job_status":"done","queue_duration_s":0.670636,"scheduling_latency_s":0.67065,"redis_calls":10,"redis_duration_s":0.001557,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011784,"completed_at":"2026-08-23T16:54:10.473Z","load_balancing_strategy":"primary","db_duration_s":0.001111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 153.101602] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.474Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e22dd6e48325242903be8601","created_at":"2026-08-23T16:54:09.783Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-34d3685891a54c30","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.791Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e22dd6e48325242903be8601: start","job_status":"start","queue_duration_s":0.683638,"scheduling_latency_s":0.683651}1502gitlab # [ 153.102337] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.481Z","message":"No existing merge request to be cleaned up."}1503gitlab # [ 153.102840] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.486Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e22dd6e48325242903be8601","created_at":"2026-08-23T16:54:09.783Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-34d3685891a54c30","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.791Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e22dd6e48325242903be8601: done: 0.011426 sec","job_status":"done","queue_duration_s":0.683638,"scheduling_latency_s":0.683651,"redis_calls":10,"redis_duration_s":0.001377,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000838,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011426,"completed_at":"2026-08-23T16:54:10.486Z","load_balancing_strategy":"primary","db_duration_s":0.001451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 153.116989] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.487Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7c5266a6520a7d6cafc5ca81","created_at":"2026-08-23T16:54:09.783Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-34d3685891a54c30","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.791Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7c5266a6520a7d6cafc5ca81: start","job_status":"start","queue_duration_s":0.695911,"scheduling_latency_s":0.695926}1505gitlab # [ 153.155083] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.493Z","message":"No existing merge request to be cleaned up."}1506gitlab # [ 153.155634] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:10.498Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7c5266a6520a7d6cafc5ca81","created_at":"2026-08-23T16:54:09.783Z","trace_propagation_headers":{"sentry-trace":"246698ad4fda4cb29b3cfaf79c5ebcb9-34d3685891a54c30","baggage":"sentry-trace_id=246698ad4fda4cb29b3cfaf79c5ebcb9,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8ea94c511a032104d3575a1cbeb340de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:09.791Z","job_size_bytes":2,"pid":1623,"sidekiq_tid":"madf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7c5266a6520a7d6cafc5ca81: done: 0.01104 sec","job_status":"done","queue_duration_s":0.695911,"scheduling_latency_s":0.695926,"redis_calls":10,"redis_duration_s":0.001284,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01104,"completed_at":"2026-08-23T16:54:10.498Z","load_balancing_strategy":"primary","db_duration_s":0.001033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 153.329612] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2908881411 wd_nsec: 29088814631508gitlab # [ 163.491722] setup-gitlab-start[2237]: W, [2026-08-23T16:54:22.578428 #2237] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1509gitlab # [ 186.188754] postgres[2441]: [2441] ERROR: relation "table_without_models" does not exist1510gitlab # [ 186.190576] postgres[2441]: [2441] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1511gitlab # [ 189.164563] runuser[2236]: pam_unix(runuser:session): session closed for user gitlab1512gitlab # [ 189.167613] setup-gitlab-start[2216]: + systemctl restart gitlab-sidekiq.service1513gitlab # [ 189.188642] systemd[1]: Stopping gitlab-sidekiq.service...1514gitlab # [ 189.189990] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:48.276Z","message":"Shutting down"}1515gitlab # [ 189.190977] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:48.276Z","message":"Scheduler exiting..."}1516gitlab # [ 189.191985] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:48.277Z","message":"Terminating quiet threads for default capsule"}1517gitlab # [ 189.192995] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:48.278Z","message":"Scheduler exiting..."}1518gitlab # [ 189.695642] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:48.782Z","message":"Pausing to allow jobs to finish..."}1519gitlab # [ 191.699255] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:50.785Z","message":"Bye!"}1520gitlab # [ 191.725484] sidekiq-cluster[1623]: {"severity":"INFO","time":"2026-08-23T16:54:50.812Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1623,"worker_id":"sidekiq_0","memwd_rss_bytes":937795584,"retry":0}1521gitlab # [ 192.744132] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1522gitlab # [ 192.744967] systemd[1]: Stopped gitlab-sidekiq.service.1523gitlab # [ 192.745712] systemd[1]: gitlab-sidekiq.service: Consumed 57.504s CPU time over 1min 58.169s wall clock time, 1002.3M memory peak, 11.6M read from disk.1524gitlab # [ 192.752306] systemd[1]: Started gitlab-sidekiq.service.1525gitlab # [ 192.753929] setup-gitlab-start[2216]: + mkdir -p /var/lib/secrets1526gitlab # [ 192.756165] setup-gitlab-start[2216]: + echo nixbot-test-token-of-20-chars1527gitlab # [ 192.757053] setup-gitlab-start[2216]: + chmod 644 /var/lib/secrets/gitlab-token1528gitlab # [ 192.758470] setup-gitlab-start[2216]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1529gitlab # [ 193.503936] gitaly[885]: time="2026-08-23T16:54:52.590Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.589" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1530gitlab # [ 193.505844] gitaly[885]: time="2026-08-23T16:54:52.592Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.589" grpc.time_ms=2.526 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1531gitlab # [ 193.624253] gitaly[885]: time="2026-08-23T16:54:52.711Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.130" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.711" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1532gitlab # [ 193.635453] gitaly[885]: time="2026-08-23T16:54:52.711Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.130" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.711" grpc.time_ms=0.308 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1533gitlab # [ 193.700325] gitaly[885]: time="2026-08-23T16:54:52.787Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV diskcache=b2b2a5ce-56b3-44a8-b375-cd39d0915db6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T16:55:02.159" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.740" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 193.708716] gitaly[885]: time="2026-08-23T16:54:52.787Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T16:55:02.159" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.740" grpc.time_ms=46.746 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 193.719442] gitaly[885]: time="2026-08-23T16:54:52.804Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.223" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.803" pid=885 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1536gitlab # [ 193.727814] gitaly[885]: time="2026-08-23T16:54:52.804Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.223" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.803" grpc.time_ms=0.906 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1537gitlab # [ 193.736896] gitaly[885]: time="2026-08-23T16:54:52.823Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:55:02.229" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.809" grpc.time_ms=13.056 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1538gitlab # [ 193.814802] gitaly[885]: time="2026-08-23T16:54:52.901Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.901" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1539gitlab # [ 193.835697] gitaly[885]: time="2026-08-23T16:54:52.902Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.901" grpc.time_ms=0.395 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1540gitlab # [ 193.871343] gitaly[885]: time="2026-08-23T16:54:52.958Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV diskcache=c481d5b0-024e-4348-8131-b14a737c36d9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T16:55:02.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.904" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1541gitlab # [ 193.872096] gitaly[885]: time="2026-08-23T16:54:52.958Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1578 command.oublock=32 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T16:55:02.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.904" grpc.time_ms=53.411 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1542gitlab # [ 193.881161] gitaly[885]: time="2026-08-23T16:54:52.968Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.067" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.967" pid=885 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1543gitlab # [ 193.882552] gitaly[885]: time="2026-08-23T16:54:52.968Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:02.067" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.967" grpc.time_ms=0.344 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1544gitlab # [ 193.897098] gitaly[885]: time="2026-08-23T16:54:52.984Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:55:02.074" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:52.974" grpc.time_ms=9.474 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1545gitlab # [ 193.931875] gitaly[885]: time="2026-08-23T16:54:53.018Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:03.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:53.018" grpc.time_ms=0.235 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1546gitlab # [ 193.941778] gitaly[885]: time="2026-08-23T16:54:53.028Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T16:55:03.018" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:53.028" grpc.time_ms=0.238 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1547gitlab # [ 194.349751] gitaly[885]: time="2026-08-23T16:54:53.436Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQRPPKKS15DKPG3HPCBQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:55:03.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:53.427" grpc.time_ms=8.843 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 194.745643] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:53 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 19681549gitlab # [ 194.747862] setup-gitlab-start[2216]: + mkdir -p /tmp/test-flake1550gitlab # [ 194.754587] setup-gitlab-start[2216]: + cd /tmp/test-flake1551gitlab # [ 194.755996] setup-gitlab-start[2216]: + git init -b master1552gitlab # [ 194.768935] setup-gitlab-start[2527]: Initialized empty Git repository in /tmp/test-flake/.git/1553gitlab # [ 194.770328] setup-gitlab-start[2216]: + git config user.name test1554gitlab # [ 194.777589] setup-gitlab-start[2216]: + git config user.email test@example.com1555gitlab # [ 194.783682] setup-gitlab-start[2216]: + cat1556gitlab # [ 194.788354] setup-gitlab-start[2216]: + git add flake.nix1557gitlab # [ 194.795848] setup-gitlab-start[2216]: + git commit -m 'initial commit'1558gitlab # [ 194.814371] setup-gitlab-start[2532]: [master (root-commit) 70c5488] initial commit1559gitlab # [ 194.815131] setup-gitlab-start[2532]: 1 file changed, 10 insertions(+)1560gitlab # [ 194.815736] setup-gitlab-start[2532]: create mode 100644 flake.nix1561gitlab # [ 194.820861] setup-gitlab-start[2216]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1562gitlab # [ 194.831614] setup-gitlab-start[2216]: + git push -u origin master1563gitlab # [ 194.957864] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1001564gitlab # [ 195.161632] gitaly[885]: time="2026-08-23T16:54:54.248Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQTV2FQ3YG7FH6MNE85V3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:54.240" grpc.time_ms=7.301 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1565gitlab # [ 195.162840] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1981566gitlab # [ 195.449363] gitaly[885]: time="2026-08-23T16:54:54.536Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:55:04.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:54.530" grpc.time_ms=5.435 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1567gitlab # [ 195.474697] gitaly[885]: time="2026-08-23T16:54:54.561Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T16:55:24.055" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T16:54:54.555" grpc.time_ms=6.326 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1568gitlab # [ 195.512151] gitaly[885]: time="2026-08-23T16:54:54.598Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD duration_ms=160ns method=POST pid=885 status=200 url="http://unix/api/v4/internal/allowed"1569gitlab # [ 195.537860] gitaly[885]: time="2026-08-23T16:54:54.624Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD duration_ms=25ns method=POST pid=885 status=200 url="http://unix/api/v4/internal/pre_receive"1570gitlab # [ 195.539349] gitaly[885]: time="2026-08-23T16:54:54.625Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:54.436" grpc.time_ms=189.377 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1571gitlab # [ 195.602969] gitaly[885]: time="2026-08-23T16:54:54.690Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:54.689" grpc.time_ms=0.587 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1572gitlab # [ 195.651315] gitaly[885]: time="2026-08-23T16:54:54.738Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:54.737" grpc.time_ms=0.997 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1573gitlab # [ 195.689667] gitaly[885]: time="2026-08-23T16:54:54.776Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:54.776" grpc.time_ms=0.576 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1574gitlab # [ 195.807811] gitaly[885]: time="2026-08-23T16:54:54.894Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:55:04.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:54.883" grpc.time_ms=11.318 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 195.837997] gitaly[885]: time="2026-08-23T16:54:54.924Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1569 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T16:55:04.020" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:54:54.900" grpc.time_ms=23.881 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1576gitlab # [ 195.870634] gitaly[885]: time="2026-08-23T16:54:54.957Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD duration_ms=140ns method=POST pid=885 status=200 url="http://unix/api/v4/internal/post_receive"1577gitlab # [ 195.871944] gitaly[885]: time="2026-08-23T16:54:54.958Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:54.816" grpc.time_ms=142.208 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1578gitlab # [ 195.902408] gitaly[885]: time="2026-08-23T16:54:54.989Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD diskcache=80922e5b-8369-417a-a573-68b14be770bc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:54.358" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1579gitlab # [ 195.903629] gitaly[885]: time="2026-08-23T16:54:54.989Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=206 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=901120 command.minflt=13501 command.oublock=32 command.real_time_ms=618 command.spawn_token_fork_ms=0 command.system_time_ms=125 command.user_time_ms=81 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:54.358" grpc.time_ms=631.458 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1580gitlab # [ 195.922879] gitlab-workhorse[826]: time="2026-08-23T16:54:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521581gitlab # [ 195.923820] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:55 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7201582gitlab # [ 195.927665] setup-gitlab-start[2536]: To http://gitlab/root/test-flake.git1583gitlab # [ 195.928571] setup-gitlab-start[2536]: * [new branch] master -> master1584gitlab # [ 195.933237] setup-gitlab-start[2536]: branch 'master' set up to track 'origin/master'.1585gitlab # [ 195.934620] sidekiq-cluster[2480]: {"severity":"INFO","time":"2026-08-23T16:54:55.003Z","message":"Starting cluster with 1 processes"}1586gitlab # [ 195.937957] systemd[1]: Finished setup-gitlab.service.1587gitlab # [ 195.940809] systemd[1]: Starting nixbot CI service...1588gitlab: (finished: waiting for unit setup-gitlab.service, in 197.03 seconds)1589gitlab: waiting for unit nixbot.service1590gitlab # [ 196.958786] nixbot[2628]: {"ts": "2026-08-23T16:54:56.044Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1591gitlab # [ 196.990661] nixbot[2628]: {"ts": "2026-08-23T16:54:56.077Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1592gitlab # [ 197.004773] nixbot[2628]: {"ts": "2026-08-23T16:54:56.091Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1593gitlab # [ 197.009732] nixbot[2628]: {"ts": "2026-08-23T16:54:56.095Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1594gitlab # [ 197.014713] nixbot[2628]: {"ts": "2026-08-23T16:54:56.099Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1595gitlab # [ 197.019596] nixbot[2628]: {"ts": "2026-08-23T16:54:56.104Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1596gitlab # [ 197.024665] nixbot[2628]: {"ts": "2026-08-23T16:54:56.107Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1597gitlab # [ 197.029544] nixbot[2628]: {"ts": "2026-08-23T16:54:56.109Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1598gitlab # [ 197.034248] nixbot[2628]: {"ts": "2026-08-23T16:54:56.113Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1599gitlab # [ 197.039182] nixbot[2628]: {"ts": "2026-08-23T16:54:56.116Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1600gitlab # [ 197.044249] nixbot[2628]: {"ts": "2026-08-23T16:54:56.122Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1601gitlab # [ 197.048939] nixbot[2628]: {"ts": "2026-08-23T16:54:56.127Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1602gitlab # [ 197.053337] nixbot[2628]: {"ts": "2026-08-23T16:54:56.129Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1603gitlab # [ 197.057232] nixbot[2628]: {"ts": "2026-08-23T16:54:56.131Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1604gitlab # [ 197.061489] nixbot[2628]: {"ts": "2026-08-23T16:54:56.134Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1605gitlab # [ 197.065364] nixbot[2628]: {"ts": "2026-08-23T16:54:56.136Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1606gitlab # [ 197.069212] nixbot[2628]: {"ts": "2026-08-23T16:54:56.138Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1607gitlab # [ 197.071885] nixbot[2628]: {"ts": "2026-08-23T16:54:56.140Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1608gitlab # [ 197.073914] nixbot[2628]: {"ts": "2026-08-23T16:54:56.144Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1609gitlab # [ 197.075764] nixbot[2628]: {"ts": "2026-08-23T16:54:56.146Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1610gitlab # [ 197.077728] nixbot[2628]: {"ts": "2026-08-23T16:54:56.148Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1611gitlab # [ 197.079559] nixbot[2628]: {"ts": "2026-08-23T16:54:56.152Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1612gitlab # [ 197.081419] nixbot[2628]: {"ts": "2026-08-23T16:54:56.154Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1613gitlab # [ 197.083195] nixbot[2628]: {"ts": "2026-08-23T16:54:56.156Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1614gitlab # [ 197.084965] nixbot[2628]: {"ts": "2026-08-23T16:54:56.158Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1615gitlab # [ 197.357112] nixbot[2628]: INFO: Started server process [2628]1616gitlab # [ 197.359321] nixbot[2628]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1617gitlab # [ 197.372117] nixbot[2628]: INFO: ::ffff:127.0.0.1:42108 - "GET /health HTTP/1.1" 200 OK1618gitlab # [ 197.378080] systemd[1]: Started nixbot CI service.1619gitlab # [ 197.379658] systemd[1]: Reached target Multi-User System.1620gitlab # [ 197.381064] systemd[1]: Startup finished in 1.278s (kernel) + 3.687s (initrd) + 3min 12.413s (userspace) = 3min 17.379s.1621gitlab: (finished: waiting for unit nixbot.service, in 1.06 seconds)1622gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1623gitlab # [ 197.514501] nixbot[2628]: INFO: ::ffff:127.0.0.1:42122 - "GET /health HTTP/1.1" 200 OK1624gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1625subtest: project discovered and webhook registered1626gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1627gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.11 seconds)1628gitlab # [ 197.618699] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 771629gitlab # [ 198.080670] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7071630gitlab # [ 198.082989] nixbot[2628]: {"ts": "2026-08-23T16:54:57.167Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1631gitlab # [ 198.096510] nixbot[2628]: {"ts": "2026-08-23T16:54:57.183Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1632gitlab # [ 198.181673] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 771633gitlab # [ 198.182855] nixbot[2628]: {"ts": "2026-08-23T16:54:57.269Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1634gitlab # [ 198.183946] nixbot[2628]: {"ts": "2026-08-23T16:54:57.271Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1635gitlab # [ 198.307169] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1121636gitlab # [ 198.308757] nixbot[2628]: {"ts": "2026-08-23T16:54:57.395Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1637gitlab # [ 198.515298] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1951638gitlab # [ 198.517333] nixbot[2628]: {"ts": "2026-08-23T16:54:57.603Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1639gitlab # [ 198.570562] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 461640gitlab # [ 198.576326] nixbot[2628]: {"ts": "2026-08-23T16:54:57.663Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1641gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1642gitlab # [ 198.701874] nixbot[2628]: {"ts": "2026-08-23T16:54:57.788Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1643gitlab # [ 198.703986] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 1161644gitlab # [ 198.739110] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 751645gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1646(finished: subtest: project discovered and webhook registered, in 1.23 seconds)1647subtest: push delivers the webhook1648gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1649gitlab # [ 198.774517] gitaly[885]: time="2026-08-23T16:54:57.860Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYG1027C3CXKCR7K3KCF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-23T16:55:27.048" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:54:57.849" grpc.time_ms=10.947 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1650gitlab # [ 198.788519] gitaly[885]: time="2026-08-23T16:54:57.874Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYG1027C3CXKCR7K3KCF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:55:27.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:54:57.873" grpc.time_ms=0.682 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1651gitlab # [ 198.801221] gitaly[885]: time="2026-08-23T16:54:57.888Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYG1027C3CXKCR7K3KCF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-23T16:55:07.007" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:54:57.878" grpc.time_ms=8.868 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1652gitlab # [ 198.825629] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 321653gitlab # [ 198.838777] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1321654gitlab # [ 198.841094] nixbot[2628]: {"ts": "2026-08-23T16:54:57.927Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1655gitlab # [ 198.891874] gitaly[885]: time="2026-08-23T16:54:57.978Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYKS0CVQKN0ENVP2S4C1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:57.968" grpc.time_ms=8.962 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1656gitlab # [ 198.910207] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:57 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 681657gitlab # Enumerating objects: 5, done.1658gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1659gitlab # Delta compression using up to 4 threads1660gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1661gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 91.00 KiB/s, done.1662gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1663gitlab # [ 198.935899] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 921664gitlab # [ 198.938160] nixbot[2628]: {"ts": "2026-08-23T16:54:58.024Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1665gitlab # [ 198.940520] nixbot[2628]: {"ts": "2026-08-23T16:54:58.027Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1666gitlab # [ 199.032456] gitaly[885]: time="2026-08-23T16:54:58.119Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYRAEMV16Q4KFG0GMA8R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.109" grpc.time_ms=9.448 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1667gitlab # [ 199.048229] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 611668gitlab # [ 199.144185] gitaly[885]: time="2026-08-23T16:54:58.230Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T16:55:28.017" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T16:54:58.218" grpc.time_ms=12.578 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669gitlab # [ 199.167880] gitaly[885]: time="2026-08-23T16:54:58.246Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW duration_ms=75ns method=POST pid=885 status=200 url="http://unix/api/v4/internal/allowed"1670gitlab # [ 199.173580] gitaly[885]: time="2026-08-23T16:54:58.260Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYTA3RDRX4TG3AG482QD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.219" pid=885 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1671gitlab # [ 199.183056] gitaly[885]: time="2026-08-23T16:54:58.260Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=38 command.spawn_token_fork_ms=5 command.system_time_ms=26 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYTA3RDRX4TG3AG482QD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.219" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1672gitlab # [ 199.183771] gitlab-workhorse[826]: time="2026-08-23T16:54:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131673gitlab # [ 199.184493] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1421674gitlab # [ 199.185078] gitaly[885]: time="2026-08-23T16:54:58.261Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=38 command.spawn_token_fork_ms=5 command.system_time_ms=26 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYTA3RDRX4TG3AG482QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.219" grpc.time_ms=41.927 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1675gitlab # [ 199.188581] gitaly[885]: time="2026-08-23T16:54:58.275Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW duration_ms=29ns method=POST pid=885 status=200 url="http://unix/api/v4/internal/pre_receive"1676gitlab # [ 199.190265] gitaly[885]: time="2026-08-23T16:54:58.276Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:58.169" grpc.time_ms=106.78 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1677gitlab # [ 199.240763] gitaly[885]: time="2026-08-23T16:54:58.327Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:58.327" grpc.time_ms=0.564 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1678gitlab # [ 199.279818] gitaly[885]: time="2026-08-23T16:54:58.366Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:58.365" grpc.time_ms=0.574 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1679gitlab # [ 199.313183] gitaly[885]: time="2026-08-23T16:54:58.399Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:58.397" grpc.time_ms=0.763 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1680gitlab # [ 199.382629] gitaly[885]: time="2026-08-23T16:54:58.469Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW duration_ms=39ns method=POST pid=885 status=200 url="http://unix/api/v4/internal/post_receive"1681gitlab # [ 199.385213] gitaly[885]: time="2026-08-23T16:54:58.471Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:58.429" grpc.time_ms=41.893 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1682gitlab # [ 199.408879] gitaly[885]: time="2026-08-23T16:54:58.496Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZ03MKGFJ8H56D8K98D8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.476" pid=885 remote_ip="2001:db8:1::1" request_sha=6fb51428c878c579c653b0eec224858b565ddfa7 response_bytes=223 span.kind=server system=grpc1683gitlab # [ 199.411481] gitaly[885]: time="2026-08-23T16:54:58.497Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1207 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZ03MKGFJ8H56D8K98D8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.476" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1684gitlab # [ 199.412636] gitlab-workhorse[826]: time="2026-08-23T16:54:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231685gitlab # [ 199.413480] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1891686gitlab # [ 199.414049] gitaly[885]: time="2026-08-23T16:54:58.497Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1207 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZ03MKGFJ8H56D8K98D8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.476" grpc.time_ms=21.123 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1687gitlab # [ 199.445428] gitaly[885]: time="2026-08-23T16:54:58.532Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW diskcache=72ac7189-ff3c-4e32-a82b-509818c5ea42 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.096" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1688gitlab # [ 199.446905] gitaly[885]: time="2026-08-23T16:54:58.532Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=185 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13522 command.oublock=32 command.real_time_ms=389 command.spawn_token_fork_ms=1 command.system_time_ms=138 command.user_time_ms=47 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.096" grpc.time_ms=436.589 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1689gitlab # [ 199.447642] gitlab-workhorse[826]: time="2026-08-23T16:54:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521690gitlab # [ 199.448218] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:58 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5181691gitlab # To http://gitlab/root/test-flake.git1692gitlab # 70c5488..a26b0f6 master -> master1693gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.74 seconds)1694gitlab: must succeed: git -C /tmp/test-flake rev-parse master1695gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1696gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1697gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.06 seconds)1698gitlab # [ 199.549165] nixbot[2628]: INFO: ::ffff:127.0.0.1:42128 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1699gitlab # [ 199.553027] gitaly[885]: time="2026-08-23T16:54:58.639Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZ8Q8B98VYKZMKX3E7T2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.629" grpc.time_ms=9.733 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1700gitlab # [ 199.554106] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 561701gitlab # [ 199.642902] gitaly[885]: time="2026-08-23T16:54:58.729Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZB2VM1PPZH122PTR6A3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.719" pid=885 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1702gitlab # [ 199.643774] gitaly[885]: time="2026-08-23T16:54:58.730Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZB2VM1PPZH122PTR6A3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.719" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1703gitlab # [ 199.685332] gitaly[885]: time="2026-08-23T16:54:58.772Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZB2VM1PPZH122PTR6A3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.719" grpc.time_ms=52.54 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1704gitlab # [ 199.686752] gitlab-workhorse[826]: time="2026-08-23T16:54:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671705gitlab # [ 199.687863] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1151706gitlab # [ 199.788924] gitaly[885]: time="2026-08-23T16:54:58.875Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZF44HYV9GYB760ETDQQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.855" pid=885 remote_ip="2001:db8:1::1" request_sha=32f8bdb5e80abe493155779f57998be57a279a7e response_bytes=337 span.kind=server system=grpc1707gitlab # [ 199.790148] gitaly[885]: time="2026-08-23T16:54:58.875Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZF44HYV9GYB760ETDQQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.855" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1708gitlab # [ 199.832869] gitaly[885]: time="2026-08-23T16:54:58.876Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZF44HYV9GYB760ETDQQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:58.855" grpc.time_ms=20.22 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1709gitlab # [ 199.834708] gitlab-workhorse[826]: time="2026-08-23T16:54:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371710gitlab # [ 199.836242] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 1321711gitlab # [ 199.950734] gitaly[885]: time="2026-08-23T16:54:59.037Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZN57Z2MHEE3WVS204NM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:59.029" grpc.time_ms=7.962 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1712gitlab # [ 199.974961] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 791713gitlab # [ 200.065321] gitaly[885]: time="2026-08-23T16:54:59.152Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZQQNC3278NSBKTQZ8YR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:59.132" pid=885 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1714gitlab # [ 200.066200] gitaly[885]: time="2026-08-23T16:54:59.152Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1161 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZQQNC3278NSBKTQZ8YR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:59.132" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1715gitlab # [ 200.066757] gitaly[885]: time="2026-08-23T16:54:59.153Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1161 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZQQNC3278NSBKTQZ8YR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:54:59.132" grpc.time_ms=20.346 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1716gitlab # [ 200.067454] gitlab-workhorse[826]: time="2026-08-23T16:54:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091717gitlab # [ 200.068854] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 901718gitlab # [ 200.211583] gitaly[885]: time="2026-08-23T16:54:59.298Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:55:29.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:54:59.297" grpc.time_ms=0.689 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1719gitlab # [ 200.259285] gitaly[885]: time="2026-08-23T16:54:59.346Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T16:55:29.136" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:54:59.336" grpc.time_ms=9.626 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720gitlab # [ 200.293192] gitaly[885]: time="2026-08-23T16:54:59.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:09.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:54:59.369" grpc.time_ms=10.878 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1721gitlab # [ 200.321954] gitaly[885]: time="2026-08-23T16:54:59.409Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:09.038" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:54:59.399" grpc.time_ms=9.783 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1722gitlab # [ 200.395951] gitaly[885]: time="2026-08-23T16:54:59.482Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T16:55:09.122" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:59.482" grpc.time_ms=0.229 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1723gitlab # [ 200.420531] gitaly[885]: time="2026-08-23T16:54:59.507Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=618 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T16:55:09.140" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:54:59.501" grpc.time_ms=6.071 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1724gitlab # [ 200.483871] gitaly[885]: time="2026-08-23T16:54:59.570Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:59.570" grpc.time_ms=0.585 pid=885 span.kind=server system=grpc1725gitlab # [ 200.521844] gitaly[885]: time="2026-08-23T16:54:59.608Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:54:59.608" grpc.time_ms=0.505 pid=885 span.kind=server system=grpc1726gitlab # [ 200.538866] gitaly[885]: time="2026-08-23T16:54:59.625Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC diskcache=7c8bfc78-51f4-471d-a764-1ab2c9d0b50b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T16:55:09.160" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:59.520" pid=885 ref=refs/keep-around/70c5488fdab694dd0ead34cd7cfed7511c2c199d remote_ip="2001:db8:1::1" revision=70c5488fdab694dd0ead34cd7cfed7511c2c199d span.kind=server system=grpc username=root1727gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1728gitlab # [ 200.548701] gitaly[885]: time="2026-08-23T16:54:59.626Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=93 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5390 command.oublock=8 command.real_time_ms=98 command.spawn_token_fork_ms=0 command.system_time_ms=60 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T16:55:09.160" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:54:59.520" grpc.time_ms=105.381 pid=885 ref=refs/keep-around/70c5488fdab694dd0ead34cd7cfed7511c2c199d remote_ip="2001:db8:1::1" revision=70c5488fdab694dd0ead34cd7cfed7511c2c199d span.kind=server system=grpc username=root1729gitlab # [ 200.549568] gitaly[885]: time="2026-08-23T16:54:59.630Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:55:29.429" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:54:59.630" grpc.time_ms=0.448 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1730gitlab # [ 200.587961] nixbot[2628]: INFO: ::ffff:127.0.0.1:42132 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1731gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1732gitlab # [ 200.694753] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:54:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5311733gitlab # [ 200.696322] nixbot[2628]: {"ts": "2026-08-23T16:54:59.782Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d \"HTTP/1.1 201 Created\""}1734gitlab # [ 200.715764] nixbot[2628]: {"ts": "2026-08-23T16:54:59.802Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-70c5488fdab6-0"}1735gitlab # [ 200.775920] systemd[1]: Started Nix Daemon.1736gitlab # [ 200.851658] nix-daemon[2844]: accepted connection from pid 2838, user nixbot1737gitlab # [ 200.934823] nix-daemon[2844]: accepted connection from pid 2851, user nixbot1738gitlab # [ 200.952814] nixbot[2628]: {"ts": "2026-08-23T16:55:00.039Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-70c5488fdab6-0", "argv0": "bwrap"}1739gitlab # [ 201.077919] nix-daemon[2844]: accepted connection from pid 2861, user nixbot1740gitlab # [ 201.127379] nix-daemon[2844]: accepted connection from pid 2871, user nixbot1741gitlab # [ 201.143657] nix-daemon[2844]: accepted connection from pid 2861, user nixbot1742gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1743gitlab # [ 201.626188] nixbot[2628]: INFO: ::ffff:127.0.0.1:42134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1744gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1745gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1746gitlab # [ 202.652046] nixbot[2628]: INFO: ::ffff:127.0.0.1:42142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1747gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.02 seconds)1748gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1749gitlab # [ 203.688395] nixbot[2628]: INFO: ::ffff:127.0.0.1:56178 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1750gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1751gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1752gitlab # [ 204.727325] nixbot[2628]: INFO: ::ffff:127.0.0.1:56184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1753gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1754gitlab # [ 205.589525] nix-daemon[2844]: accepted connection from pid 2895, user nixbot1755gitlab # [ 205.634501] gitaly[885]: time="2026-08-23T16:55:04.720Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRR56F9A3D4FDACQA29K3N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:55:34.216" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:04.716" grpc.time_ms=3.789 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1756gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1757gitlab # [ 205.743407] gitaly[885]: time="2026-08-23T16:55:04.830Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRR56F9A3D4FDACQA29K3N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:14.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:04.820" grpc.time_ms=9.815 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 205.773784] nixbot[2628]: INFO: ::ffff:127.0.0.1:56190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1759gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1760gitlab # [ 205.821548] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2521761gitlab # [ 205.822338] nixbot[2628]: {"ts": "2026-08-23T16:55:04.909Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d \"HTTP/1.1 201 Created\""}1762gitlab # [ 205.873753] gitaly[885]: time="2026-08-23T16:55:04.960Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRR5EH3BT1K8TK669XJ2RX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:55:34.758" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:04.959" grpc.time_ms=0.751 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 205.947982] gitaly[885]: time="2026-08-23T16:55:05.035Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRR5EH3BT1K8TK669XJ2RX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:15.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:05.022" grpc.time_ms=11.982 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 206.016088] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1881765gitlab # [ 206.017620] nixbot[2628]: {"ts": "2026-08-23T16:55:05.103Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d \"HTTP/1.1 201 Created\""}1766gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1767gitlab # [ 206.813139] nixbot[2628]: INFO: ::ffff:127.0.0.1:56202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1768gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1769gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1770gitlab # [ 207.851266] nixbot[2628]: INFO: ::ffff:127.0.0.1:56204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1771gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1772gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1773gitlab # [ 208.888393] nixbot[2628]: INFO: ::ffff:127.0.0.1:56220 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1774gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1775gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1776gitlab # [ 209.925902] nixbot[2628]: INFO: ::ffff:127.0.0.1:56226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1777gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1778gitlab # [ 209.961914] nix-daemon[2844]: accepted connection from pid 2947, user nixbot1779gitlab # [ 210.047290] gitaly[885]: time="2026-08-23T16:55:09.133Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRR9GNZB92BC6JSCW5FHFJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:55:39.032" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:09.132" grpc.time_ms=0.698 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1780gitlab # [ 210.114755] gitaly[885]: time="2026-08-23T16:55:09.201Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRR9GNZB92BC6JSCW5FHFJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:19.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:09.190" grpc.time_ms=11.347 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1781gitlab # [ 210.148165] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1561782gitlab # [ 210.149877] nixbot[2628]: {"ts": "2026-08-23T16:55:09.235Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d \"HTTP/1.1 201 Created\""}1783gitlab # [ 210.218330] nix-daemon[2844]: accepted connection from pid 2961, user nixbot1784gitlab # [ 210.317288] gitaly[885]: time="2026-08-23T16:55:09.404Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRR9S10ANZAEK6ZNCGZYTP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:09.397" grpc.time_ms=6.421 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1785gitlab # [ 210.344109] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 851786gitlab # [ 210.405624] gitaly[885]: time="2026-08-23T16:55:09.492Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRR9VWC0NSQNCGQQZNBJ5C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:09.480" pid=885 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1787gitlab # [ 210.406769] gitaly[885]: time="2026-08-23T16:55:09.492Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRR9VWC0NSQNCGQQZNBJ5C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:09.480" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1788gitlab # [ 210.408489] gitaly[885]: time="2026-08-23T16:55:09.495Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRR9VWC0NSQNCGQQZNBJ5C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:09.480" grpc.time_ms=14.83 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc1789gitlab # [ 210.409167] gitlab-workhorse[826]: time="2026-08-23T16:55:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671790gitlab # [ 210.409409] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 581791gitlab # [ 210.540215] nix-daemon[2844]: accepted connection from pid 2986, user nixbot1792gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1793gitlab # [ 210.962711] nixbot[2628]: INFO: ::ffff:127.0.0.1:56242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1794gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1795gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1796gitlab # [ 212.000448] nixbot[2628]: INFO: ::ffff:127.0.0.1:56248 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1797gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1798gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1799gitlab # [ 213.037603] nixbot[2628]: INFO: ::ffff:127.0.0.1:45124 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1800gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1801gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1802gitlab # [ 214.075873] nixbot[2628]: INFO: ::ffff:127.0.0.1:45136 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1803gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1804gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1805gitlab # [ 215.114596] nixbot[2628]: INFO: ::ffff:127.0.0.1:45148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1806gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1807gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1808gitlab # [ 216.152406] nixbot[2628]: INFO: ::ffff:127.0.0.1:45150 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1809gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1810gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1811gitlab # [ 217.190532] nixbot[2628]: INFO: ::ffff:127.0.0.1:45154 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1812gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1813gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1814gitlab # [ 218.226944] nixbot[2628]: INFO: ::ffff:127.0.0.1:45166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1815gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1816gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1817gitlab # [ 219.264490] nixbot[2628]: INFO: ::ffff:127.0.0.1:45174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1818gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1819gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1820gitlab # [ 220.304156] nixbot[2628]: INFO: ::ffff:127.0.0.1:45188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1821gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1822gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1823gitlab # [ 221.342379] nixbot[2628]: INFO: ::ffff:127.0.0.1:45190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1824gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1825gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1826gitlab # [ 222.379265] nixbot[2628]: INFO: ::ffff:127.0.0.1:45200 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1827gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1828gitlab # [ 222.578089] sidekiq-cluster[2624]: 2026-08-23T16:55:21.664Z pid=2624 tid=xd4 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2624, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>437116928}1829gitlab # [ 222.746728] sidekiq-cluster[2624]: W, [2026-08-23T16:55:21.833539 #2624] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1830gitlab # [ 222.818183] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:21.905Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1831gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1832gitlab # [ 223.420323] nixbot[2628]: INFO: ::ffff:127.0.0.1:44858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1833gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1834gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1835gitlab # [ 224.459227] nixbot[2628]: INFO: ::ffff:127.0.0.1:44874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1836gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1837gitlab # [ 224.623712] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:23.709Z","message":"GitLab reliable fetch activated!"}1838gitlab # [ 224.625392] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:23.710Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1839gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1840gitlab # [ 225.500787] nixbot[2628]: INFO: ::ffff:127.0.0.1:44884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1841gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1843gitlab # [ 226.539941] nixbot[2628]: INFO: ::ffff:127.0.0.1:44888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1844gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1845gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1846gitlab # [ 227.577987] nixbot[2628]: INFO: ::ffff:127.0.0.1:44902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1847gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1848gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1849gitlab # [ 228.615684] nixbot[2628]: INFO: ::ffff:127.0.0.1:44906 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1850gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1851gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1852gitlab # [ 229.651866] nixbot[2628]: INFO: ::ffff:127.0.0.1:44910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1853gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1854gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1855gitlab # [ 230.688148] nixbot[2628]: INFO: ::ffff:127.0.0.1:44914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1856gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1857gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1858gitlab # [ 231.724742] nixbot[2628]: INFO: ::ffff:127.0.0.1:44922 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1859gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1860gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1861gitlab # [ 232.760137] nixbot[2628]: INFO: ::ffff:127.0.0.1:44928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1862gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1863gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1864gitlab # [ 233.797106] nixbot[2628]: INFO: ::ffff:127.0.0.1:37216 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1865gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1866gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1867gitlab # [ 234.833066] nixbot[2628]: INFO: ::ffff:127.0.0.1:37230 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1868gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1869gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1870gitlab # [ 235.869148] nixbot[2628]: INFO: ::ffff:127.0.0.1:37240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1871gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1872gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1873gitlab # [ 236.903532] nixbot[2628]: INFO: ::ffff:127.0.0.1:37254 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1874gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1875gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1876gitlab # [ 237.938321] nixbot[2628]: INFO: ::ffff:127.0.0.1:37256 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1877gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1878gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1879gitlab # [ 238.973467] nixbot[2628]: INFO: ::ffff:127.0.0.1:37264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1880gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1881gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1882gitlab # [ 240.003996] nixbot[2628]: INFO: ::ffff:127.0.0.1:37274 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1883gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1884gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1885gitlab # [ 241.038660] nixbot[2628]: INFO: ::ffff:127.0.0.1:37286 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1886gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1887gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1888gitlab # [ 242.070303] nixbot[2628]: INFO: ::ffff:127.0.0.1:37298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1889gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1892gitlab # [ 243.101942] nixbot[2628]: INFO: ::ffff:127.0.0.1:32798 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1894gitlab # [ 244.134642] nixbot[2628]: INFO: ::ffff:127.0.0.1:32810 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1895gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1896gitlab # [ 244.182607] postgres[3108]: [3108] ERROR: relation "table_without_models" does not exist1897gitlab # [ 244.184278] postgres[3108]: [3108] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1898gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1899gitlab # [ 245.170909] nixbot[2628]: INFO: ::ffff:127.0.0.1:32814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1900gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1901gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1902gitlab # [ 246.207429] nixbot[2628]: INFO: ::ffff:127.0.0.1:32820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1903gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1904gitlab # [ 246.856603] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:45.942Z","message":"Booted Rails 7.2.3.1 application in production environment"}1905gitlab # [ 246.858133] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:45.943Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1906gitlab # [ 246.858692] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:45.943Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1907gitlab # [ 246.859445] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:45.943Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1908gitlab # [ 246.860554] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:45.945Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1910gitlab # [ 247.243923] nixbot[2628]: INFO: ::ffff:127.0.0.1:32822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1913gitlab # [ 248.280351] nixbot[2628]: INFO: ::ffff:127.0.0.1:32836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1915gitlab # [ 248.550197] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:47.636Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"5522c666f331c4a527f4a920","created_at":"2026-08-23T16:54:52.847Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:52.874Z","job_size_bytes":2,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-5522c666f331c4a527f4a920: start","job_status":"start","queue_duration_s":54.761258,"scheduling_latency_s":54.761313}1916gitlab # [ 248.752343] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:47.838Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"5522c666f331c4a527f4a920","created_at":"2026-08-23T16:54:52.847Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:52.874Z","job_size_bytes":2,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-5522c666f331c4a527f4a920: done: 0.202784 sec","job_status":"done","queue_duration_s":54.761258,"scheduling_latency_s":54.761313,"redis_calls":25,"redis_duration_s":0.007607,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004378,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001835,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.095980635,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.202784,"completed_at":"2026-08-23T16:55:47.838Z","load_balancing_strategy":"primary","db_duration_s":0.064474,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1917gitlab # [ 248.827055] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:47.841Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"50a8e3eb4f882799e2609399","created_at":"2026-08-23T16:54:52.884Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:52.893Z","job_size_bytes":2,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-50a8e3eb4f882799e2609399: start","job_status":"start","queue_duration_s":54.947327,"scheduling_latency_s":54.947361}1918gitlab # [ 248.854351] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:47.941Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"50a8e3eb4f882799e2609399","created_at":"2026-08-23T16:54:52.884Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:52.893Z","job_size_bytes":2,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-50a8e3eb4f882799e2609399: done: 0.100108 sec","job_status":"done","queue_duration_s":54.947327,"scheduling_latency_s":54.947361,"redis_calls":14,"redis_duration_s":0.003858,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000945,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001357,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.074506956,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.100108,"completed_at":"2026-08-23T16:55:47.941Z","load_balancing_strategy":"primary","db_duration_s":0.024351,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1919gitlab # [ 248.873849] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:47.942Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1a5c2f682d970844d5bc63ca","created_at":"2026-08-23T16:54:53.349Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:53.354Z","job_size_bytes":5,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1a5c2f682d970844d5bc63ca: start","job_status":"start","queue_duration_s":54.588177,"scheduling_latency_s":54.588192}1920gitlab # [ 248.980521] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:48.067Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1a5c2f682d970844d5bc63ca","created_at":"2026-08-23T16:54:53.349Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:53.354Z","job_size_bytes":5,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1a5c2f682d970844d5bc63ca: done: 0.124549 sec","job_status":"done","queue_duration_s":54.588177,"scheduling_latency_s":54.588192,"redis_calls":12,"redis_duration_s":0.002711,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00062,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001708,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000383,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032574,"duration_s":0.124549,"completed_at":"2026-08-23T16:55:48.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026344,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1921gitlab # [ 249.050763] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:48.137Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"04f72a4fe2e076878aaefb9a","created_at":"2026-08-23T16:54:53.376Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:53.380Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-04f72a4fe2e076878aaefb9a: start","job_status":"start","queue_duration_s":54.756816,"scheduling_latency_s":54.756866}1922gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1923gitlab # [ 249.251978] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:48.338Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"04f72a4fe2e076878aaefb9a","created_at":"2026-08-23T16:54:53.376Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:53.380Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-04f72a4fe2e076878aaefb9a: done: 0.201597 sec","job_status":"done","queue_duration_s":54.756816,"scheduling_latency_s":54.756866,"redis_calls":11,"redis_duration_s":0.003299,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001049,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.153,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.153,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279365,"duration_s":0.201597,"completed_at":"2026-08-23T16:55:48.338Z","load_balancing_strategy":"primary","db_duration_s":0.073903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1924gitlab # [ 249.330442] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:48.417Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"744572b8d37c38b03c0d43d4","created_at":"2026-08-23T16:54:53.382Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:53.386Z","job_size_bytes":89,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-744572b8d37c38b03c0d43d4: start","job_status":"start","queue_duration_s":55.030324,"scheduling_latency_s":55.030357}1925gitlab # [ 249.355668] nixbot[2628]: INFO: ::ffff:127.0.0.1:32842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.07 seconds)1927gitlab # [ 249.378195] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:48.464Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"744572b8d37c38b03c0d43d4","created_at":"2026-08-23T16:54:53.382Z","trace_propagation_headers":{"sentry-trace":"37008a64703042a799f8d2e1c4d5774d-3cc7ecbda3aa4e61","baggage":"sentry-trace_id=37008a64703042a799f8d2e1c4d5774d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQRPPKKS15DKPG3HPCBQV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:53.386Z","job_size_bytes":89,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-744572b8d37c38b03c0d43d4: done: 0.047919 sec","job_status":"done","queue_duration_s":55.030324,"scheduling_latency_s":55.030357,"redis_calls":11,"redis_duration_s":0.0023480000000000003,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000679,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257015,"duration_s":0.047919,"completed_at":"2026-08-23T16:55:48.464Z","load_balancing_strategy":"primary","db_duration_s":0.006085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1928gitlab # [ 249.416294] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:48.503Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 70c5488fdab694dd0ead34cd7cfed7511c2c199d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a04d540e7f206a77180b4467","created_at":"2026-08-23T16:54:54.845Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-196f132d836a465e","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:54.862Z","job_size_bytes":185,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a04d540e7f206a77180b4467: start","job_status":"start","queue_duration_s":53.641015,"scheduling_latency_s":53.64104}1929gitlab # [ 249.429503] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:48.516Z","message":"changes: \"0000000000000000000000000000000000000000 70c5488fdab694dd0ead34cd7cfed7511c2c199d refs/heads/master\\n\""}1930gitlab # [ 249.466459] gitaly[885]: time="2026-08-23T16:55:48.552Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:58.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:48.540" grpc.time_ms=11.632 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 249.491629] gitaly[885]: time="2026-08-23T16:55:48.578Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:55:58.028" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:48.568" grpc.time_ms=9.876 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 249.558735] gitaly[885]: time="2026-08-23T16:55:48.645Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T16:55:58.091" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:48.631" grpc.time_ms=13.623 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 249.622091] gitaly[885]: time="2026-08-23T16:55:48.709Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:48.708" grpc.time_ms=0.773 pid=885 span.kind=server system=grpc1934gitlab # [ 249.677284] gitaly[885]: time="2026-08-23T16:55:48.764Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:48.763" grpc.time_ms=0.626 pid=885 span.kind=server system=grpc1935gitlab # [ 249.706187] gitaly[885]: time="2026-08-23T16:55:48.793Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD diskcache=b536c76d-6def-4db4-a5a5-3d1f5803a9c6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T16:55:58.129" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:48.670" pid=885 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1936gitlab # [ 249.707352] gitaly[885]: time="2026-08-23T16:55:48.793Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=136 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5159 command.oublock=8 command.real_time_ms=115 command.spawn_token_fork_ms=0 command.system_time_ms=88 command.user_time_ms=48 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T16:55:58.129" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:48.670" grpc.time_ms=122.774 pid=885 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1937gitlab # [ 249.750149] gitaly[885]: time="2026-08-23T16:55:48.837Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:55:58.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:48.836" grpc.time_ms=0.251 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 249.771285] gitaly[885]: time="2026-08-23T16:55:48.858Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=937 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T16:55:58.016" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:48.846" grpc.time_ms=11.58 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 249.886869] gitaly[885]: time="2026-08-23T16:55:48.973Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-23T16:56:18.065" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:48.965" grpc.time_ms=7.886 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 249.955727] gitaly[885]: time="2026-08-23T16:55:49.042Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T16:55:59.001" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:49.042" grpc.time_ms=0.503 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 249.988065] gitaly[885]: time="2026-08-23T16:55:49.075Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T16:55:59.026" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T16:55:49.067" grpc.time_ms=7.392 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1942gitlab # [ 250.016230] gitaly[885]: time="2026-08-23T16:55:49.103Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:59.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:49.091" grpc.time_ms=11.244 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab # [ 250.054346] gitaly[885]: time="2026-08-23T16:55:49.141Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:59.090" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:49.130" grpc.time_ms=10.589 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944gitlab # [ 250.091451] gitaly[885]: time="2026-08-23T16:55:49.178Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T16:56:19.059" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:49.159" grpc.time_ms=18.291 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1945gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1946gitlab # [ 250.394685] nixbot[2628]: INFO: ::ffff:127.0.0.1:32854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1947gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1948gitlab # [ 250.512646] gitaly[885]: time="2026-08-23T16:55:49.598Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T16:55:59.057" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:49.597" grpc.time_ms=1.239 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 250.570936] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:49.656Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 70c5488fdab694dd0ead34cd7cfed7511c2c199d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a04d540e7f206a77180b4467","created_at":"2026-08-23T16:54:54.845Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-196f132d836a465e","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:54.862Z","job_size_bytes":185,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a04d540e7f206a77180b4467: done: 1.153707 sec","job_status":"done","queue_duration_s":53.641015,"scheduling_latency_s":53.64104,"gitaly_calls":13,"gitaly_duration_s":0.415927,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.077405,"redis_read_bytes":2103,"redis_write_bytes":21748,"redis_cache_calls":15,"redis_cache_duration_s":0.006127,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.007435,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001939,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004427,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.020101,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.037376,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.204,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.231,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.056,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.599688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000463746,"exclusive_lock_hold_duration_s":0.04076384,"duration_s":1.153707,"completed_at":"2026-08-23T16:55:49.656Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.101837,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1950gitlab # [ 250.643710] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:49.730Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","70c5488fdab694dd0ead34cd7cfed7511c2c199d a26b0f6c8f96201506c406ca039b46e4fa868bcf refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1c8cc9bace69d0c3c9227581","created_at":"2026-08-23T16:54:58.454Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-8e6616d037d04d46","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:58.455Z","job_size_bytes":185,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1c8cc9bace69d0c3c9227581: start","job_status":"start","queue_duration_s":51.274239,"scheduling_latency_s":51.274372}1951gitlab # [ 250.661915] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:49.748Z","message":"changes: \"70c5488fdab694dd0ead34cd7cfed7511c2c199d a26b0f6c8f96201506c406ca039b46e4fa868bcf refs/heads/master\\n\""}1952gitlab # [ 250.696850] gitaly[885]: time="2026-08-23T16:55:49.783Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:59.232" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:49.772" grpc.time_ms=10.899 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1953gitlab # [ 250.722206] gitaly[885]: time="2026-08-23T16:55:49.809Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:55:59.260" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:49.801" grpc.time_ms=7.985 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954gitlab # [ 250.737877] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:49.824Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"5015e4bf1c65cfcac0d060a6","created_at":"2026-08-23T16:55:49.822Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-bd22c38e346e4564","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"de2a29261e425cbd4a00ce10","job_size_bytes":46,"pid":2624,"job_status":"deduplicated","message":"ProjectCacheWorker JID-5015e4bf1c65cfcac0d060a6: deduplicated: until executing","deduplication.type":"until executing"}1955gitlab # [ 250.778425] gitaly[885]: time="2026-08-23T16:55:49.865Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T16:55:59.023" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:49.854" grpc.time_ms=10.891 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 250.795534] gitaly[885]: time="2026-08-23T16:55:49.882Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-23T16:56:19.770" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:49.870" grpc.time_ms=11.562 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1957gitlab # [ 250.815397] gitaly[885]: time="2026-08-23T16:55:49.902Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T16:55:59.065" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T16:55:49.895" grpc.time_ms=6.639 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 250.836072] gitaly[885]: time="2026-08-23T16:55:49.923Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:55:59.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:49.912" grpc.time_ms=10.159 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1959gitlab # [ 250.925895] gitaly[885]: time="2026-08-23T16:55:50.012Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T16:56:00.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:50.012" grpc.time_ms=0.785 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 250.975505] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:50.061Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","70c5488fdab694dd0ead34cd7cfed7511c2c199d a26b0f6c8f96201506c406ca039b46e4fa868bcf refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1c8cc9bace69d0c3c9227581","created_at":"2026-08-23T16:54:58.454Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-8e6616d037d04d46","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:54:58.455Z","job_size_bytes":185,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1c8cc9bace69d0c3c9227581: done: 0.331505 sec","job_status":"done","queue_duration_s":51.274239,"scheduling_latency_s":51.274372,"gitaly_calls":7,"gitaly_duration_s":0.113219,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.024081,"redis_read_bytes":500,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.002663,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000884,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00289,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.008495,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009149,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.026,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.026,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000899276,"exclusive_lock_hold_duration_s":0.03459909,"duration_s":0.331505,"completed_at":"2026-08-23T16:55:50.061Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02516,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1961gitlab # [ 250.980212] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:50.064Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"745e9e49db35a0354e850b24","created_at":"2026-08-23T16:54:59.633Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-a34d4746c3c04d47","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:59.664Z","job_size_bytes":65,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-745e9e49db35a0354e850b24: start","job_status":"start","queue_duration_s":50.399473,"scheduling_latency_s":50.399515}1962gitlab # [ 251.050220] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:50.136Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"745e9e49db35a0354e850b24","created_at":"2026-08-23T16:54:59.633Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-a34d4746c3c04d47","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:59.664Z","job_size_bytes":65,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-745e9e49db35a0354e850b24: done: 0.072773 sec","job_status":"done","queue_duration_s":50.399473,"scheduling_latency_s":50.399515,"redis_calls":16,"redis_duration_s":0.004142,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002066,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000363175,"duration_s":0.072773,"completed_at":"2026-08-23T16:55:50.136Z","load_balancing_strategy":"primary","db_duration_s":0.021993,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1963gitlab # [ 251.051858] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:50.138Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"62f55392ad0eab620ad39985","created_at":"2026-08-23T16:54:59.665Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-a34d4746c3c04d47","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:59.670Z","job_size_bytes":65,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-62f55392ad0eab620ad39985: start","job_status":"start","queue_duration_s":50.468036,"scheduling_latency_s":50.468066}1964gitlab # [ 251.219248] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:50.305Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"62f55392ad0eab620ad39985","created_at":"2026-08-23T16:54:59.665Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-a34d4746c3c04d47","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:59.670Z","job_size_bytes":65,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-62f55392ad0eab620ad39985: done: 0.167361 sec","job_status":"done","queue_duration_s":50.468036,"scheduling_latency_s":50.468066,"redis_calls":21,"redis_duration_s":0.005134,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002151,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001386,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000392788,"duration_s":0.167361,"completed_at":"2026-08-23T16:55:50.305Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1965gitlab # [ 251.258112] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:50.344Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f9c04f8f7220178efa76f205","created_at":"2026-08-23T16:54:59.763Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-a34d4746c3c04d47","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:59.768Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f9c04f8f7220178efa76f205: start","job_status":"start","queue_duration_s":50.576612,"scheduling_latency_s":50.576652}1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1967gitlab # [ 251.431775] nixbot[2628]: INFO: ::ffff:127.0.0.1:32866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)1969gitlab # [ 251.485867] gitaly[885]: time="2026-08-23T16:55:50.572Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:50.572" grpc.time_ms=0.383 pid=885 span.kind=server system=grpc1970gitlab # [ 251.530299] gitaly[885]: time="2026-08-23T16:55:50.616Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:50.616" grpc.time_ms=0.446 pid=885 span.kind=server system=grpc1971gitlab # [ 251.575534] gitaly[885]: time="2026-08-23T16:55:50.662Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:50.662" grpc.time_ms=0.489 pid=885 span.kind=server system=grpc1972gitlab # [ 251.595322] gitaly[885]: time="2026-08-23T16:55:50.682Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC diskcache=49a1bff3-3412-4c59-9d82-cef976d0799a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:20.436" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:50.537" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 251.596558] gitaly[885]: time="2026-08-23T16:55:50.682Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=142 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7380 command.oublock=0 command.real_time_ms=137 command.spawn_token_fork_ms=0 command.system_time_ms=93 command.user_time_ms=49 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:20.436" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:50.537" grpc.time_ms=145.178 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 251.706247] gitaly[885]: time="2026-08-23T16:55:50.793Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T16:56:20.691" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:50.792" grpc.time_ms=0.942 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 251.736368] gitaly[885]: time="2026-08-23T16:55:50.823Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:20.721" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:50.821" grpc.time_ms=1.016 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 251.761214] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:50.831Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f9c04f8f7220178efa76f205","created_at":"2026-08-23T16:54:59.763Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-a34d4746c3c04d47","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:59.768Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2624,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f9c04f8f7220178efa76f205: rescheduled"}1977gitlab # [ 251.780113] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:50.839Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f9c04f8f7220178efa76f205","created_at":"2026-08-23T16:54:59.763Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-a34d4746c3c04d47","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:59.768Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f9c04f8f7220178efa76f205: done: 0.495165 sec","job_status":"done","queue_duration_s":50.576612,"scheduling_latency_s":50.576652,"gitaly_calls":3,"gitaly_duration_s":0.154389,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.032493,"redis_read_bytes":462,"redis_write_bytes":29295,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001647,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001269,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.012342,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.005018,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15582,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.00554,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001863,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000676,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002491,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.027,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.03,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.234542,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.41374895300000003,"duration_s":0.495165,"completed_at":"2026-08-23T16:55:50.839Z","load_balancing_strategy":"primary","db_duration_s":0.068872,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1978gitlab # [ 251.817173] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:50.841Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"de2a29261e425cbd4a00ce10","created_at":"2026-08-23T16:55:48.580Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:48.599Z","job_size_bytes":46,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-de2a29261e425cbd4a00ce10: start","job_status":"start","queue_duration_s":2.241232,"scheduling_latency_s":2.24125}1979gitlab # [ 251.870162] gitaly[885]: time="2026-08-23T16:55:50.957Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-23T22:55:50.950" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:50.951" grpc.time_ms=4.99 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 251.889240] gitaly[885]: time="2026-08-23T16:55:50.976Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T16:56:20.066" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:50.966" grpc.time_ms=9.059 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 251.937316] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:51.023Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"de2a29261e425cbd4a00ce10","created_at":"2026-08-23T16:55:48.580Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:48.599Z","job_size_bytes":46,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-de2a29261e425cbd4a00ce10: done: 0.182711 sec","job_status":"done","queue_duration_s":2.241232,"scheduling_latency_s":2.24125,"gitaly_calls":2,"gitaly_duration_s":0.030941,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008667,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002156,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000789,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001845,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003153,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000436927,"duration_s":0.182711,"completed_at":"2026-08-23T16:55:51.023Z","load_balancing_strategy":"primary","db_duration_s":0.069112,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1982gitlab # [ 251.942603] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:51.025Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"4de1eba0fbffb3515ab3d649","created_at":"2026-08-23T16:55:48.619Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:48.625Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-4de1eba0fbffb3515ab3d649: start","job_status":"start","queue_duration_s":2.399958,"scheduling_latency_s":2.399987}1983gitlab # [ 251.987863] gitaly[885]: time="2026-08-23T16:55:51.074Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD diskcache=1ecfccd0-2bcc-4eab-80d3-af77cb65572e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T22:55:51.047" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:51.047" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 251.988684] gitaly[885]: time="2026-08-23T16:55:51.075Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1288 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T22:55:51.047" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:51.047" grpc.time_ms=27.09 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 252.020861] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:51.107Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"4de1eba0fbffb3515ab3d649","created_at":"2026-08-23T16:55:48.619Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:48.625Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-4de1eba0fbffb3515ab3d649: done: 0.081775 sec","job_status":"done","queue_duration_s":2.399958,"scheduling_latency_s":2.399987,"gitaly_calls":1,"gitaly_duration_s":0.029778,"redis_calls":15,"redis_duration_s":0.003617,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000442,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00061,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060196198,"duration_s":0.081775,"completed_at":"2026-08-23T16:55:51.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1986gitlab # [ 252.059082] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:51.108Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6cd5f82e1c8851e30f0ebe47","created_at":"2026-08-23T16:55:48.829Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:48.832Z","job_size_bytes":23,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6cd5f82e1c8851e30f0ebe47: start","job_status":"start","queue_duration_s":2.276275,"scheduling_latency_s":2.276294}1987gitlab # [ 252.060051] gitaly[885]: time="2026-08-23T16:55:51.140Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T16:56:21.028" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:51.129" grpc.time_ms=10.805 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 252.061580] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:51.148Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6cd5f82e1c8851e30f0ebe47","created_at":"2026-08-23T16:55:48.829Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:48.832Z","job_size_bytes":23,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6cd5f82e1c8851e30f0ebe47: done: 0.039473 sec","job_status":"done","queue_duration_s":2.276275,"scheduling_latency_s":2.276294,"gitaly_calls":1,"gitaly_duration_s":0.012994,"redis_calls":16,"redis_duration_s":0.003222,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000296,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001418,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039473,"completed_at":"2026-08-23T16:55:51.148Z","load_balancing_strategy":"primary","db_duration_s":0.002403,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1989gitlab # [ 252.111409] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:51.149Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a5488bd95f1550217964be98","created_at":"2026-08-23T16:55:49.464Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:725d4aea2919512c58e5824f7982d0288ab22c9e3c7c027f9c881bb26764edfa","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:49.470Z","job_size_bytes":467,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a5488bd95f1550217964be98: start","job_status":"start","queue_duration_s":1.679236,"scheduling_latency_s":1.679256}1990gitlab # [ 252.112401] gitaly[885]: time="2026-08-23T16:55:51.170Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:21.069" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:51.169" grpc.time_ms=0.575 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 252.113164] gitaly[885]: time="2026-08-23T16:55:51.179Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T16:56:01.162" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:51.172" grpc.time_ms=7.237 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1992gitlab # [ 252.177200] gitaly[885]: time="2026-08-23T16:55:51.264Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T16:56:21.162" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:51.263" grpc.time_ms=1.084 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 252.186345] gitaly[885]: time="2026-08-23T16:55:51.273Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=279 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T16:56:21.168" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:51.269" grpc.time_ms=3.975 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994gitlab # [ 252.296620] gitaly[885]: time="2026-08-23T16:55:51.383Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:56:01.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:51.370" grpc.time_ms=12.55 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'1996gitlab # [ 252.478414] nixbot[2628]: INFO: ::ffff:127.0.0.1:32872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.05 seconds)1998gitlab # [ 252.772352] gitaly[885]: time="2026-08-23T16:55:51.859Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T16:56:21.747" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:51.847" grpc.time_ms=11.203 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 252.792683] gitaly[885]: time="2026-08-23T16:55:51.879Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQV2GA7GVFY9XTCQN45QD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T16:56:21.771" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:51.872" grpc.time_ms=7.552 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 252.829392] sidekiq-cluster[2624]: {"severity":"WARN","time":"2026-08-23T16:55:51.916Z","class":"CreatePipelineWorker","correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"70c5488fdab694dd0ead34cd7cfed7511c2c199d","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"70c5488fdab694dd0ead34cd7cfed7511c2c199d","ref":"refs/heads/master"},"retry":0}2001gitlab # [ 252.834883] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:51.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a5488bd95f1550217964be98","created_at":"2026-08-23T16:55:49.464Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:725d4aea2919512c58e5824f7982d0288ab22c9e3c7c027f9c881bb26764edfa","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:49.470Z","job_size_bytes":467,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a5488bd95f1550217964be98: done: 0.77209 sec","job_status":"done","queue_duration_s":1.679236,"scheduling_latency_s":1.679256,"gitaly_calls":7,"gitaly_duration_s":0.097805,"redis_calls":51,"redis_duration_s":0.009441,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001042,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003778,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002677,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000796,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.61611,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000322108,"duration_s":0.77209,"completed_at":"2026-08-23T16:55:51.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047579,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2002gitlab # [ 252.839231] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:51.923Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"dc09b9d6-a569-4a87-bca9-5788464d8fd0\"}"],"class":"WebHookWorker","jid":"b6a783a075badc88132c2652","created_at":"2026-08-23T16:55:49.570Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8848c0933cf9bddf3513caf9767d16459470c3dc7d924d7b62e7e916507ed9e4","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:49.576Z","job_size_bytes":1751,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b6a783a075badc88132c2652: start","job_status":"start","queue_duration_s":2.346482,"scheduling_latency_s":2.3465}2003gitlab # [ 252.955084] nixbot[2628]: INFO: ::ffff:127.0.0.1:32874 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2004gitlab # [ 252.971430] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.058Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"dc09b9d6-a569-4a87-bca9-5788464d8fd0\"}"],"class":"WebHookWorker","jid":"b6a783a075badc88132c2652","created_at":"2026-08-23T16:55:49.570Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-43f8a17e9927441f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8848c0933cf9bddf3513caf9767d16459470c3dc7d924d7b62e7e916507ed9e4","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:49.576Z","job_size_bytes":1751,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b6a783a075badc88132c2652: done: 0.13488 sec","job_status":"done","queue_duration_s":2.346482,"scheduling_latency_s":2.3465,"redis_calls":19,"redis_duration_s":0.003063,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000831,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000213,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0007,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05438540299999772,"cpu_s":0.067248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000249194,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.13488,"completed_at":"2026-08-23T16:55:52.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2005gitlab # [ 253.016439] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.059Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9c3d79fae20b9fcd6ca7db2b","created_at":"2026-08-23T16:55:49.845Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-bd22c38e346e4564","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"4de1eba0fbffb3515ab3d649","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:49.848Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9c3d79fae20b9fcd6ca7db2b: start","job_status":"start","queue_duration_s":2.210591,"scheduling_latency_s":2.210613}2006gitlab # [ 253.022515] gitaly[885]: time="2026-08-23T16:55:52.109Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW diskcache=f5481d54-5c37-46a5-893b-dc816e3287cf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T22:55:52.074" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.075" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 253.023129] gitaly[885]: time="2026-08-23T16:55:52.109Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T22:55:52.074" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.075" grpc.time_ms=34.342 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2008gitlab # [ 253.061554] gitaly[885]: time="2026-08-23T16:55:52.140Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:22.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.139" grpc.time_ms=0.466 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009gitlab # [ 253.062188] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.122Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9c3d79fae20b9fcd6ca7db2b","created_at":"2026-08-23T16:55:49.845Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-bd22c38e346e4564","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"4de1eba0fbffb3515ab3d649","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:49.848Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9c3d79fae20b9fcd6ca7db2b: done: 0.06291 sec","job_status":"done","queue_duration_s":2.210591,"scheduling_latency_s":2.210613,"gitaly_calls":1,"gitaly_duration_s":0.036551,"redis_calls":12,"redis_duration_s":0.002628,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000717,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.047789594,"duration_s":0.06291,"completed_at":"2026-08-23T16:55:52.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003742,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2010gitlab # [ 253.102718] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.123Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d3ec10a02b61c63d3075a1fe","created_at":"2026-08-23T16:55:49.983Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-bd22c38e346e4564","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b9b99fca3913e9fd8cce1c5623ec8184d2260d03a257a5f990a533bf07087fe0","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:49.986Z","job_size_bytes":467,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d3ec10a02b61c63d3075a1fe: start","job_status":"start","queue_duration_s":2.136872,"scheduling_latency_s":2.13689}2011gitlab # [ 253.103588] gitaly[885]: time="2026-08-23T16:55:52.147Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T16:56:02.131" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:52.141" grpc.time_ms=5.564 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab # [ 253.105434] gitaly[885]: time="2026-08-23T16:55:52.169Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T16:56:22.068" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.169" grpc.time_ms=0.573 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013gitlab # [ 253.116067] gitaly[885]: time="2026-08-23T16:55:52.173Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=57 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T16:56:22.071" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.172" grpc.time_ms=1.639 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab # [ 253.160062] gitaly[885]: time="2026-08-23T16:55:52.195Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:56:02.179" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:52.190" grpc.time_ms=5.592 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 253.238826] gitaly[885]: time="2026-08-23T16:55:52.325Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSKG062MXMQ2TRWTDCDQD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:52.317" grpc.time_ms=7.722 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2016gitlab # [ 253.240213] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2612017gitlab # [ 253.298179] gitaly[885]: time="2026-08-23T16:55:52.385Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSKR9ZWD1Y7E542J3457K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:52.372" pid=885 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2018gitlab # [ 253.300394] gitaly[885]: time="2026-08-23T16:55:52.385Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSKR9ZWD1Y7E542J3457K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:52.372" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2019gitlab # [ 253.302517] gitlab-workhorse[826]: time="2026-08-23T16:55:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672020gitlab # [ 253.304072] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 562021gitlab # [ 253.305248] gitaly[885]: time="2026-08-23T16:55:52.385Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSKR9ZWD1Y7E542J3457K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:52.372" grpc.time_ms=13.217 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2022gitlab # [ 253.376868] nixbot[2628]: {"ts": "2026-08-23T16:55:52.463Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2023gitlab # [ 253.442647] gitaly[885]: time="2026-08-23T16:55:52.529Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSKWYXHNR5S88JPPGWM9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:22.428" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.528" grpc.time_ms=0.695 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'2025gitlab # [ 253.489051] gitaly[885]: time="2026-08-23T16:55:52.576Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSKWYXHNR5S88JPPGWM9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:56:02.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:52.566" grpc.time_ms=9.329 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.03 seconds)2027gitlab # [ 253.505970] gitaly[885]: time="2026-08-23T16:55:52.592Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=970 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T16:56:22.480" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.581" grpc.time_ms=11.719 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab # [ 253.513947] nixbot[2628]: INFO: ::ffff:127.0.0.1:57568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK2029gitlab # [ 253.518323] gitaly[885]: time="2026-08-23T16:55:52.605Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQYPZ07HFAQKHK7CH0RRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T16:56:22.495" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.595" grpc.time_ms=9.447 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030gitlab # [ 253.530993] sidekiq-cluster[2624]: {"severity":"WARN","time":"2026-08-23T16:55:52.618Z","class":"CreatePipelineWorker","correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"70c5488fdab694dd0ead34cd7cfed7511c2c199d","after":"a26b0f6c8f96201506c406ca039b46e4fa868bcf","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a26b0f6c8f96201506c406ca039b46e4fa868bcf","ref":"refs/heads/master"},"retry":0}2031gitlab # [ 253.534921] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1432032gitlab # [ 253.538082] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d3ec10a02b61c63d3075a1fe","created_at":"2026-08-23T16:55:49.983Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-bd22c38e346e4564","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b9b99fca3913e9fd8cce1c5623ec8184d2260d03a257a5f990a533bf07087fe0","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:49.986Z","job_size_bytes":467,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d3ec10a02b61c63d3075a1fe: done: 0.499309 sec","job_status":"done","queue_duration_s":2.136872,"scheduling_latency_s":2.13689,"gitaly_calls":7,"gitaly_duration_s":0.048052,"redis_calls":33,"redis_duration_s":0.003146,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000344,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001461,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000592,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.436498,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.499309,"completed_at":"2026-08-23T16:55:52.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011082,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2033gitlab # [ 253.582271] nixbot[2628]: {"ts": "2026-08-23T16:55:52.623Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d \"HTTP/1.1 201 Created\""}2034gitlab # [ 253.582917] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.629Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ffd9e783-58bf-49a0-9924-e6059f64b21a\"}"],"class":"WebHookWorker","jid":"1af2ec2c1b0360a5ba9be4a9","created_at":"2026-08-23T16:55:50.001Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-bd22c38e346e4564","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fb3359d6c6be6174ea132126c9decf19342942f703b987d2c3e9292d5ba25388","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.003Z","job_size_bytes":1749,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1af2ec2c1b0360a5ba9be4a9: start","job_status":"start","queue_duration_s":2.625515,"scheduling_latency_s":2.625547}2035gitlab # [ 253.584591] gitaly[885]: time="2026-08-23T16:55:52.671Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSM1NW0FCT9BZZPXT85YB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:22.470" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.671" grpc.time_ms=0.515 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2036gitlab # [ 253.587764] nixbot[2628]: INFO: ::ffff:127.0.0.1:57584 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2037gitlab # [ 253.597771] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.684Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ffd9e783-58bf-49a0-9924-e6059f64b21a\"}"],"class":"WebHookWorker","jid":"1af2ec2c1b0360a5ba9be4a9","created_at":"2026-08-23T16:55:50.001Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-bd22c38e346e4564","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fb3359d6c6be6174ea132126c9decf19342942f703b987d2c3e9292d5ba25388","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.003Z","job_size_bytes":1749,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1af2ec2c1b0360a5ba9be4a9: done: 0.055147 sec","job_status":"done","queue_duration_s":2.625515,"scheduling_latency_s":2.625547,"redis_calls":14,"redis_duration_s":0.002394,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000238,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00131,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007681423000008181,"cpu_s":0.020132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.055147,"completed_at":"2026-08-23T16:55:52.684Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010408,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2038gitlab # [ 253.644806] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.686Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d9e6487f764c7ec578570747","created_at":"2026-08-23T16:55:50.516Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.524Z","job_size_bytes":23,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d9e6487f764c7ec578570747: start","job_status":"start","queue_duration_s":2.162346,"scheduling_latency_s":2.162368}2039gitlab # [ 253.667079] gitaly[885]: time="2026-08-23T16:55:52.754Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSM1NW0FCT9BZZPXT85YB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:56:02.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:52.747" grpc.time_ms=6.408 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2040gitlab # [ 253.672581] gitaly[885]: time="2026-08-23T16:55:52.759Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSM48G6SGXXMTQYGPA3AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:52.754" grpc.time_ms=5.051 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2041gitlab # [ 253.678658] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.765Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d9e6487f764c7ec578570747","created_at":"2026-08-23T16:55:50.516Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.524Z","job_size_bytes":23,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d9e6487f764c7ec578570747: done: 0.078995 sec","job_status":"done","queue_duration_s":2.162346,"scheduling_latency_s":2.162368,"redis_calls":10,"redis_duration_s":0.012068,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000616,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008023924,"duration_s":0.078995,"completed_at":"2026-08-23T16:55:52.765Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012868,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2042gitlab # [ 253.691595] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.771Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"94878c1dcb1a0c1ca060bfbe","created_at":"2026-08-23T16:55:50.690Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.698Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-94878c1dcb1a0c1ca060bfbe: start","job_status":"start","queue_duration_s":2.073419,"scheduling_latency_s":2.073437}2043gitlab # [ 253.730652] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.800Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"94878c1dcb1a0c1ca060bfbe","created_at":"2026-08-23T16:55:50.690Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.698Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-94878c1dcb1a0c1ca060bfbe: done: 0.02902 sec","job_status":"done","queue_duration_s":2.073419,"scheduling_latency_s":2.073437,"redis_calls":10,"redis_duration_s":0.004159,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001708,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286349,"duration_s":0.02902,"completed_at":"2026-08-23T16:55:52.800Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2044gitlab # [ 253.771693] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.801Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fd509881bfcf558c6a873a43","created_at":"2026-08-23T16:55:50.714Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.722Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fd509881bfcf558c6a873a43: start","job_status":"start","queue_duration_s":2.079193,"scheduling_latency_s":2.079209}2045gitlab # [ 253.772468] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1032046gitlab # [ 253.773098] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2012047gitlab # [ 253.774212] nixbot[2628]: {"ts": "2026-08-23T16:55:52.832Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d \"HTTP/1.1 201 Created\""}2048gitlab # [ 253.774792] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.835Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fd509881bfcf558c6a873a43","created_at":"2026-08-23T16:55:50.714Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.722Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fd509881bfcf558c6a873a43: done: 0.033494 sec","job_status":"done","queue_duration_s":2.079193,"scheduling_latency_s":2.079209,"redis_calls":10,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000349206,"duration_s":0.033494,"completed_at":"2026-08-23T16:55:52.835Z","load_balancing_strategy":"primary","db_duration_s":0.008215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2049gitlab # [ 253.794483] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.836Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"19ed71d592c4b23b5213701c","created_at":"2026-08-23T16:55:50.738Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.743Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-19ed71d592c4b23b5213701c: start","job_status":"start","queue_duration_s":2.093495,"scheduling_latency_s":2.093513}2050gitlab # [ 253.807397] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.874Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"19ed71d592c4b23b5213701c","created_at":"2026-08-23T16:55:50.738Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.743Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-19ed71d592c4b23b5213701c: done: 0.03817 sec","job_status":"done","queue_duration_s":2.093495,"scheduling_latency_s":2.093513,"redis_calls":13,"redis_duration_s":0.008542,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000456,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005591,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000814,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001681,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000845079,"duration_s":0.03817,"completed_at":"2026-08-23T16:55:52.874Z","load_balancing_strategy":"primary","db_duration_s":0.005519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2051gitlab # [ 253.862036] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.876Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a00265c253d0fe383de015d7","created_at":"2026-08-23T16:55:50.743Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.748Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a00265c253d0fe383de015d7: start","job_status":"start","queue_duration_s":2.1283,"scheduling_latency_s":2.128316}2052gitlab # [ 253.862891] gitaly[885]: time="2026-08-23T16:55:52.880Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSM836Y3ZFC593JJZBZCV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:22.678" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:52.878" grpc.time_ms=1.969 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 253.868055] gitaly[885]: time="2026-08-23T16:55:52.898Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSM7HXRXX8130F1G4M50T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:52.885" pid=885 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2054gitlab # [ 253.910977] gitlab-workhorse[826]: time="2026-08-23T16:55:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672055gitlab # [ 253.911594] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 822056gitlab # [ 253.912044] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1442057gitlab # [ 253.912529] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.908Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a00265c253d0fe383de015d7","created_at":"2026-08-23T16:55:50.743Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.748Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a00265c253d0fe383de015d7: done: 0.031366 sec","job_status":"done","queue_duration_s":2.1283,"scheduling_latency_s":2.128316,"redis_calls":10,"redis_duration_s":0.003634,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00173,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001501,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230755,"duration_s":0.031366,"completed_at":"2026-08-23T16:55:52.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2058gitlab # [ 253.943608] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.909Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bd4454141e7a46a8afcf7ad1","created_at":"2026-08-23T16:55:50.749Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.752Z","job_size_bytes":19,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bd4454141e7a46a8afcf7ad1: start","job_status":"start","queue_duration_s":2.156901,"scheduling_latency_s":2.156916}2059gitlab # [ 253.944221] gitaly[885]: time="2026-08-23T16:55:52.899Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSM7HXRXX8130F1G4M50T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:52.885" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2060gitlab # [ 253.944764] nixbot[2628]: {"ts": "2026-08-23T16:55:52.982Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/70c5488fdab694dd0ead34cd7cfed7511c2c199d \"HTTP/1.1 201 Created\""}2061gitlab # [ 253.951421] nix-daemon[2844]: accepted connection from pid 3327, user nixbot2062gitlab # [ 253.952106] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.934Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bd4454141e7a46a8afcf7ad1","created_at":"2026-08-23T16:55:50.749Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.752Z","job_size_bytes":19,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bd4454141e7a46a8afcf7ad1: done: 0.025497 sec","job_status":"done","queue_duration_s":2.156901,"scheduling_latency_s":2.156916,"redis_calls":11,"redis_duration_s":0.004155,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003348,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000221536,"duration_s":0.025497,"completed_at":"2026-08-23T16:55:52.934Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2063gitlab # [ 254.013864] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.939Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"bb93dec266e395b9f5ff1f1f","created_at":"2026-08-23T16:55:50.754Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.758Z","job_size_bytes":66,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-bb93dec266e395b9f5ff1f1f: start","job_status":"start","queue_duration_s":2.181178,"scheduling_latency_s":2.181194}2064gitlab # [ 254.014627] gitaly[885]: time="2026-08-23T16:55:52.900Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSM7HXRXX8130F1G4M50T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:52.885" grpc.time_ms=14.232 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2065gitlab # [ 254.015207] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1502066gitlab # [ 254.015633] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.985Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"bb93dec266e395b9f5ff1f1f","created_at":"2026-08-23T16:55:50.754Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.758Z","job_size_bytes":66,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-bb93dec266e395b9f5ff1f1f: done: 0.045585 sec","job_status":"done","queue_duration_s":2.181178,"scheduling_latency_s":2.181194,"redis_calls":10,"redis_duration_s":0.00386,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00052,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002173,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217346,"duration_s":0.045585,"completed_at":"2026-08-23T16:55:52.985Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2067gitlab # [ 254.062273] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:52.986Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b652e5d27919db2a99f3e903","created_at":"2026-08-23T16:55:50.759Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.762Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b652e5d27919db2a99f3e903: start","job_status":"start","queue_duration_s":2.224285,"scheduling_latency_s":2.224299}2068gitlab # [ 254.063441] gitaly[885]: time="2026-08-23T16:55:52.928Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSM836Y3ZFC593JJZBZCV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:56:02.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:52.917" grpc.time_ms=10.519 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 254.100178] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.017Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b652e5d27919db2a99f3e903","created_at":"2026-08-23T16:55:50.759Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.762Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b652e5d27919db2a99f3e903: done: 0.030918 sec","job_status":"done","queue_duration_s":2.224285,"scheduling_latency_s":2.224299,"redis_calls":10,"redis_duration_s":0.004734,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00096,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000980013,"duration_s":0.030918,"completed_at":"2026-08-23T16:55:53.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2070gitlab # [ 254.136353] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.020Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5ee8f76020ada2d4459132f9","created_at":"2026-08-23T16:55:50.766Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.769Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5ee8f76020ada2d4459132f9: start","job_status":"start","queue_duration_s":2.250031,"scheduling_latency_s":2.250044}2071gitlab # [ 254.137104] gitaly[885]: time="2026-08-23T16:55:53.094Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSMBG5N9CW0GBE0MZMNFF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:53.087" grpc.time_ms=6.567 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2072gitlab # [ 254.137755] gitaly[885]: time="2026-08-23T16:55:53.154Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMG8KVAYCS62NDVYRXQF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:53.145" pid=885 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2073gitlab # [ 254.139073] gitlab-workhorse[826]: time="2026-08-23T16:55:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672074gitlab # [ 254.139887] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 582075gitlab # [ 254.141510] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 432076gitlab # [ 254.143479] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.058Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5ee8f76020ada2d4459132f9","created_at":"2026-08-23T16:55:50.766Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.769Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5ee8f76020ada2d4459132f9: done: 0.038771 sec","job_status":"done","queue_duration_s":2.250031,"scheduling_latency_s":2.250044,"redis_calls":10,"redis_duration_s":0.005195,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002267,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022461,"duration_s":0.038771,"completed_at":"2026-08-23T16:55:53.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2077gitlab # [ 254.183878] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.060Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2573ef52ba0bcd44273c3e7f","created_at":"2026-08-23T16:55:50.770Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.773Z","job_size_bytes":6,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2573ef52ba0bcd44273c3e7f: start","job_status":"start","queue_duration_s":2.287837,"scheduling_latency_s":2.287853}2078gitlab # [ 254.192822] gitaly[885]: time="2026-08-23T16:55:53.154Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMG8KVAYCS62NDVYRXQF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:53.145" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2079gitlab # [ 254.204028] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.085Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2573ef52ba0bcd44273c3e7f","created_at":"2026-08-23T16:55:50.770Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.773Z","job_size_bytes":6,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2573ef52ba0bcd44273c3e7f: done: 0.02447 sec","job_status":"done","queue_duration_s":2.287837,"scheduling_latency_s":2.287853,"redis_calls":10,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000446147,"duration_s":0.02447,"completed_at":"2026-08-23T16:55:53.085Z","load_balancing_strategy":"primary","db_duration_s":0.002725,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2080gitlab # [ 254.248100] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.086Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cc6f67958c0ac123045c5b6c","created_at":"2026-08-23T16:55:50.773Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.776Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cc6f67958c0ac123045c5b6c: start","job_status":"start","queue_duration_s":2.310229,"scheduling_latency_s":2.310243}2081gitlab # [ 254.256027] gitlab-workhorse[826]: time="2026-08-23T16:55:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212082gitlab # [ 254.258820] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 632083gitlab # [ 254.259600] gitaly[885]: time="2026-08-23T16:55:53.154Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMG8KVAYCS62NDVYRXQF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:53.145" grpc.time_ms=8.958 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2084gitlab # [ 254.299628] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.133Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cc6f67958c0ac123045c5b6c","created_at":"2026-08-23T16:55:50.773Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.776Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cc6f67958c0ac123045c5b6c: done: 0.047159 sec","job_status":"done","queue_duration_s":2.310229,"scheduling_latency_s":2.310243,"redis_calls":10,"redis_duration_s":0.001824,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000523531,"duration_s":0.047159,"completed_at":"2026-08-23T16:55:53.133Z","load_balancing_strategy":"primary","db_duration_s":0.024654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2085gitlab # [ 254.338148] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.134Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"adcd130f37bfb7c4b36fdcc7","created_at":"2026-08-23T16:55:50.780Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.783Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-adcd130f37bfb7c4b36fdcc7: start","job_status":"start","queue_duration_s":2.351559,"scheduling_latency_s":2.351574}2086gitlab # [ 254.338779] gitaly[885]: time="2026-08-23T16:55:53.223Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSMJX7NPXVW28RF056YJ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:53.217" grpc.time_ms=6.178 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2087gitlab # [ 254.339490] gitaly[885]: time="2026-08-23T16:55:53.289Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMMA4P0Q96C82R9M7T6D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:53.272" pid=885 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc2088gitlab # [ 254.340108] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.208Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"adcd130f37bfb7c4b36fdcc7","created_at":"2026-08-23T16:55:50.780Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.783Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-adcd130f37bfb7c4b36fdcc7: done: 0.074008 sec","job_status":"done","queue_duration_s":2.351559,"scheduling_latency_s":2.351574,"redis_calls":14,"redis_duration_s":0.018393,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000644,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.012538,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002186591,"duration_s":0.074008,"completed_at":"2026-08-23T16:55:53.208Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2089gitlab # [ 254.383790] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.210Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"b832dee94c010a6d586f91f4","created_at":"2026-08-23T16:55:50.832Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.833Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b832dee94c010a6d586f91f4: start","job_status":"start","queue_duration_s":2.376468,"scheduling_latency_s":2.37649}2090gitlab # [ 254.386915] gitaly[885]: time="2026-08-23T16:55:53.289Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMMA4P0Q96C82R9M7T6D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:53.272" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2091gitlab # [ 254.397875] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.441Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"b832dee94c010a6d586f91f4","created_at":"2026-08-23T16:55:50.832Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.833Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2624,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b832dee94c010a6d586f91f4: rescheduled"}2092gitlab # [ 254.438588] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.446Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"b832dee94c010a6d586f91f4","created_at":"2026-08-23T16:55:50.832Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-5130a88e84d44114","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:50.833Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b832dee94c010a6d586f91f4: done: 0.236843 sec","job_status":"done","queue_duration_s":2.376468,"scheduling_latency_s":2.37649,"gitaly_calls":3,"gitaly_duration_s":0.07814,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016335,"redis_read_bytes":149,"redis_write_bytes":18010,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.00275,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002504,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002506,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12309,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003728,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000457,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000384,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001256,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.018,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094208,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.207741208,"duration_s":0.236843,"completed_at":"2026-08-23T16:55:53.446Z","load_balancing_strategy":"primary","db_duration_s":0.049502,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2093gitlab # [ 254.474059] gitaly[885]: time="2026-08-23T16:55:53.293Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMMA4P0Q96C82R9M7T6D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:53.272" grpc.time_ms=17.658 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2094gitlab # [ 254.474648] nixbot[2628]: {"ts": "2026-08-23T16:55:53.549Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a26b0f6c8f96201506c406ca039b46e4fa868bcf \"HTTP/1.1 201 Created\""}2095gitlab # [ 254.475022] nixbot[2628]: {"ts": "2026-08-23T16:55:53.555Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a26b0f6c8f96-4"}2096gitlab # [ 254.475342] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.448Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8a145816c0b32d9e3a39d0fc","created_at":"2026-08-23T16:55:51.000Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-974957c3f9d94b84","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:51.007Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8a145816c0b32d9e3a39d0fc: start","job_status":"start","queue_duration_s":2.440177,"scheduling_latency_s":2.440197}2097gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf'2098gitlab # [ 254.479585] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.483Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8a145816c0b32d9e3a39d0fc","created_at":"2026-08-23T16:55:51.000Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-974957c3f9d94b84","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:51.007Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8a145816c0b32d9e3a39d0fc: done: 0.035588 sec","job_status":"done","queue_duration_s":2.440177,"scheduling_latency_s":2.440197,"redis_calls":19,"redis_duration_s":0.006751,"redis_read_bytes":22,"redis_write_bytes":4288,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001874,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000347,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2259,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004056,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.009532776,"duration_s":0.035588,"completed_at":"2026-08-23T16:55:53.483Z","load_balancing_strategy":"primary","db_duration_s":0.004884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2099gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf', in 0.04 seconds)2100gitlab # [ 254.515773] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 2262101(finished: subtest: push delivers the webhook, in 55.81 seconds)2102subtest: eval and build post commit statuses2103gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a26b0f6c8f96201506c406ca039b46e4fa868bcf/statuses2104gitlab # [ 254.517823] gitaly[885]: time="2026-08-23T16:55:53.314Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:53.314" grpc.time_ms=0.298 pid=885 span.kind=server system=grpc2105gitlab # [ 254.551816] gitaly[885]: time="2026-08-23T16:55:53.336Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:53.336" grpc.time_ms=0.338 pid=885 span.kind=server system=grpc2106gitlab # [ 254.552669] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.484Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b6a783a075badc88132c2652"],"class":"WebHooks::LogExecutionWorker","jid":"d84e1125c65f4fa1b82c6bab","created_at":"2026-08-23T16:55:52.045Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-109fdaff81c54a9f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7cc2d618e19dd75fed91bea107464151c481952c92b276fd006b4cfc7034a401","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:52.052Z","job_size_bytes":2593,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d84e1125c65f4fa1b82c6bab: start","job_status":"start","queue_duration_s":1.432634,"scheduling_latency_s":1.432649}2107gitlab # [ 254.553465] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.520Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b6a783a075badc88132c2652"],"class":"WebHooks::LogExecutionWorker","jid":"d84e1125c65f4fa1b82c6bab","created_at":"2026-08-23T16:55:52.045Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-109fdaff81c54a9f","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7cc2d618e19dd75fed91bea107464151c481952c92b276fd006b4cfc7034a401","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:52.052Z","job_size_bytes":2593,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d84e1125c65f4fa1b82c6bab: done: 0.035625 sec","job_status":"done","queue_duration_s":1.432634,"scheduling_latency_s":1.432649,"redis_calls":10,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000329,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023746,"duration_s":0.035625,"completed_at":"2026-08-23T16:55:53.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2108gitlab # [ 254.581288] nixbot[2628]: INFO: ::ffff:127.0.0.1:57594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 200 OK2109gitlab # [ 254.582589] gitaly[885]: time="2026-08-23T16:55:53.357Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:53.356" grpc.time_ms=0.305 pid=885 span.kind=server system=grpc2110gitlab # [ 254.590178] gitaly[885]: time="2026-08-23T16:55:53.364Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC diskcache=cf8d2c96-3cfc-499c-b7be-e64b58f06b16 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:23.193" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:53.293" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 254.598215] nix-daemon[2844]: accepted connection from pid 3411, user nixbot2112gitlab # [ 254.598852] nix-daemon[2844]: accepted connection from pid 3420, user nixbot2113gitlab # [ 254.599593] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.521Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1af2ec2c1b0360a5ba9be4a9"],"class":"WebHooks::LogExecutionWorker","jid":"c4cf81de5fd8b2ea3bb249c3","created_at":"2026-08-23T16:55:52.677Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-71b9cd3f21084f7d","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ec5fb71047c6d54ee19404c4199f991546c265ef1dbc1430b3106e1f0fb14d5","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:52.679Z","job_size_bytes":2591,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c4cf81de5fd8b2ea3bb249c3: start","job_status":"start","queue_duration_s":0.84201,"scheduling_latency_s":0.842026}2114gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a26b0f6c8f96201506c406ca039b46e4fa868bcf/statuses, in 0.12 seconds)2115gitlab # [ 254.635699] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.543Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1af2ec2c1b0360a5ba9be4a9"],"class":"WebHooks::LogExecutionWorker","jid":"c4cf81de5fd8b2ea3bb249c3","created_at":"2026-08-23T16:55:52.677Z","trace_propagation_headers":{"sentry-trace":"d3d6f2eec2e54f98a047fc975aa84921-71b9cd3f21084f7d","baggage":"sentry-trace_id=d3d6f2eec2e54f98a047fc975aa84921,sentry-release=Unknown"},"correlation_id":"01M0QRQYPZ07HFAQKHK7CH0RRW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ec5fb71047c6d54ee19404c4199f991546c265ef1dbc1430b3106e1f0fb14d5","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:52.679Z","job_size_bytes":2591,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c4cf81de5fd8b2ea3bb249c3: done: 0.02134 sec","job_status":"done","queue_duration_s":0.84201,"scheduling_latency_s":0.842026,"redis_calls":7,"redis_duration_s":0.0018540000000000002,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000728,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02134,"completed_at":"2026-08-23T16:55:53.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2116gitlab # [ 254.647233] gitaly[885]: time="2026-08-23T16:55:53.365Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=61 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7226 command.oublock=0 command.real_time_ms=64 command.spawn_token_fork_ms=1 command.system_time_ms=37 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:23.193" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:53.293" grpc.time_ms=71.19 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 254.683584] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.544Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2ee82f02291b91947dd801c5","created_at":"2026-08-23T16:55:53.286Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.288Z","job_size_bytes":23,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2ee82f02291b91947dd801c5: start","job_status":"start","queue_duration_s":0.255948,"scheduling_latency_s":0.255966}2118gitlab # [ 254.684214] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.576Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2ee82f02291b91947dd801c5","created_at":"2026-08-23T16:55:53.286Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.288Z","job_size_bytes":23,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2ee82f02291b91947dd801c5: done: 0.03176 sec","job_status":"done","queue_duration_s":0.255948,"scheduling_latency_s":0.255966,"redis_calls":7,"redis_duration_s":0.0026899999999999997,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002293,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03176,"completed_at":"2026-08-23T16:55:53.576Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00697,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2119gitlab # [ 254.730996] nixbot[2628]: {"ts": "2026-08-23T16:55:53.697Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a26b0f6c8f96-4", "argv0": "bwrap"}2120gitlab # [ 254.731635] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a26b0f6c8f96201506c406ca039b46e4fa868bcf/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 882121gitlab # [ 254.732071] gitaly[885]: time="2026-08-23T16:55:53.372Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:23.171" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:53.372" grpc.time_ms=0.567 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 254.732666] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.577Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4b4f298511fc295b965f8145","created_at":"2026-08-23T16:55:53.369Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.372Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4b4f298511fc295b965f8145: start","job_status":"start","queue_duration_s":0.20501,"scheduling_latency_s":0.205033}2123gitlab # [ 254.770204] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.595Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4b4f298511fc295b965f8145","created_at":"2026-08-23T16:55:53.369Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.372Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4b4f298511fc295b965f8145: done: 0.018184 sec","job_status":"done","queue_duration_s":0.20501,"scheduling_latency_s":0.205033,"redis_calls":7,"redis_duration_s":0.000958,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018184,"completed_at":"2026-08-23T16:55:53.595Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 254.771170] gitaly[885]: time="2026-08-23T16:55:53.386Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T16:56:23.179" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:53.379" grpc.time_ms=6.832 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 254.807127] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.596Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0ca3572210e912d87c40e976","created_at":"2026-08-23T16:55:53.380Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.383Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0ca3572210e912d87c40e976: start","job_status":"start","queue_duration_s":0.213089,"scheduling_latency_s":0.21312}2126gitlab # [ 254.807836] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.613Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0ca3572210e912d87c40e976","created_at":"2026-08-23T16:55:53.380Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.383Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0ca3572210e912d87c40e976: done: 0.017428 sec","job_status":"done","queue_duration_s":0.213089,"scheduling_latency_s":0.21312,"redis_calls":7,"redis_duration_s":0.000925,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017428,"completed_at":"2026-08-23T16:55:53.613Z","load_balancing_strategy":"primary","db_duration_s":0.003312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2127gitlab # [ 254.828726] gitaly[885]: time="2026-08-23T16:55:53.397Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:56:03.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:53.391" grpc.time_ms=5.687 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 254.870047] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.614Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a31a825d2c1f77a92f4ab96d","created_at":"2026-08-23T16:55:53.390Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.391Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a31a825d2c1f77a92f4ab96d: start","job_status":"start","queue_duration_s":0.223304,"scheduling_latency_s":0.223318}2129gitlab # [ 254.870717] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.640Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a31a825d2c1f77a92f4ab96d","created_at":"2026-08-23T16:55:53.390Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.391Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a31a825d2c1f77a92f4ab96d: done: 0.025932 sec","job_status":"done","queue_duration_s":0.223304,"scheduling_latency_s":0.223318,"redis_calls":10,"redis_duration_s":0.005089,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003424,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000795,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025932,"completed_at":"2026-08-23T16:55:53.640Z","load_balancing_strategy":"primary","db_duration_s":0.005418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2130gitlab # [ 254.914225] gitaly[885]: time="2026-08-23T16:55:53.409Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T16:56:23.308" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:53.409" grpc.time_ms=0.765 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 254.914795] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.641Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"326b6b9faf0df584d479206d","created_at":"2026-08-23T16:55:53.391Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.393Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-326b6b9faf0df584d479206d: start","job_status":"start","queue_duration_s":0.248553,"scheduling_latency_s":0.248571}2132gitlab # [ 254.915499] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.659Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"326b6b9faf0df584d479206d","created_at":"2026-08-23T16:55:53.391Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.393Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-326b6b9faf0df584d479206d: done: 0.018305 sec","job_status":"done","queue_duration_s":0.248553,"scheduling_latency_s":0.248571,"redis_calls":7,"redis_duration_s":0.0009989999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018305,"completed_at":"2026-08-23T16:55:53.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2133gitlab # [ 254.944717] gitaly[885]: time="2026-08-23T16:55:53.414Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T16:56:03.053" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:53.413" grpc.time_ms=0.168 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 254.953555] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.660Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7f1960782fe21b96be57d870","created_at":"2026-08-23T16:55:53.393Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.395Z","job_size_bytes":19,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7f1960782fe21b96be57d870: start","job_status":"start","queue_duration_s":0.265739,"scheduling_latency_s":0.265755}2135gitlab # [ 254.966225] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.677Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7f1960782fe21b96be57d870","created_at":"2026-08-23T16:55:53.393Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.395Z","job_size_bytes":19,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7f1960782fe21b96be57d870: done: 0.016518 sec","job_status":"done","queue_duration_s":0.265739,"scheduling_latency_s":0.265755,"redis_calls":8,"redis_duration_s":0.001122,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016518,"completed_at":"2026-08-23T16:55:53.677Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2136gitlab # [ 255.007249] gitaly[885]: time="2026-08-23T16:55:53.422Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T16:56:03.056" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:53.416" grpc.time_ms=5.939 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 255.009555] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.678Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e7395291be69853a01ede43e","created_at":"2026-08-23T16:55:53.395Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.396Z","job_size_bytes":66,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e7395291be69853a01ede43e: start","job_status":"start","queue_duration_s":0.281522,"scheduling_latency_s":0.281539}2138gitlab # [ 255.023512] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.692Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e7395291be69853a01ede43e","created_at":"2026-08-23T16:55:53.395Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.396Z","job_size_bytes":66,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e7395291be69853a01ede43e: done: 0.014394 sec","job_status":"done","queue_duration_s":0.281522,"scheduling_latency_s":0.281539,"redis_calls":7,"redis_duration_s":0.000915,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014394,"completed_at":"2026-08-23T16:55:53.692Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2139gitlab # [ 255.072208] gitaly[885]: time="2026-08-23T16:55:53.435Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRQZXHDZJ87WVQY3VR4QDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:23.334" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:53.435" grpc.time_ms=0.376 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 255.072791] gitaly[885]: time="2026-08-23T16:55:53.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:53.452" grpc.time_ms=0.342 pid=885 span.kind=server system=grpc2141gitlab # [ 255.074622] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.693Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8564987cb994348503902722","created_at":"2026-08-23T16:55:53.397Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.398Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8564987cb994348503902722: start","job_status":"start","queue_duration_s":0.295198,"scheduling_latency_s":0.295212}2142gitlab # [ 255.087547] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.714Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8564987cb994348503902722","created_at":"2026-08-23T16:55:53.397Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.398Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8564987cb994348503902722: done: 0.020824 sec","job_status":"done","queue_duration_s":0.295198,"scheduling_latency_s":0.295212,"redis_calls":7,"redis_duration_s":0.00107,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020824,"completed_at":"2026-08-23T16:55:53.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2143gitlab # [ 255.135233] gitaly[885]: time="2026-08-23T16:55:53.479Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:53.478" grpc.time_ms=0.36 pid=885 span.kind=server system=grpc2144gitlab # [ 255.135835] gitaly[885]: time="2026-08-23T16:55:53.490Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q diskcache=1085c6a3-b2c9-446a-96d8-25b516497fa2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T16:56:03.063" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:53.423" pid=885 ref=refs/keep-around/a26b0f6c8f96201506c406ca039b46e4fa868bcf remote_ip="2001:db8:1::1" revision=a26b0f6c8f96201506c406ca039b46e4fa868bcf span.kind=server system=grpc username=root2145gitlab # [ 255.136960] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"91ae6f8f55c12eddb49e0cda","created_at":"2026-08-23T16:55:53.398Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.399Z","job_size_bytes":6,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-91ae6f8f55c12eddb49e0cda: start","job_status":"start","queue_duration_s":0.315729,"scheduling_latency_s":0.315743}2146gitlab # [ 255.149613] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.724Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"91ae6f8f55c12eddb49e0cda","created_at":"2026-08-23T16:55:53.398Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.399Z","job_size_bytes":6,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-91ae6f8f55c12eddb49e0cda: done: 0.008559 sec","job_status":"done","queue_duration_s":0.315729,"scheduling_latency_s":0.315743,"redis_calls":7,"redis_duration_s":0.000987,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008559,"completed_at":"2026-08-23T16:55:53.723Z","load_balancing_strategy":"primary","db_duration_s":0.000219,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2147gitlab # [ 255.209102] gitaly[885]: time="2026-08-23T16:55:53.491Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=49 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5144 command.oublock=8 command.real_time_ms=59 command.spawn_token_fork_ms=0 command.system_time_ms=34 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T16:56:03.063" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:55:53.423" grpc.time_ms=65.727 pid=885 ref=refs/keep-around/a26b0f6c8f96201506c406ca039b46e4fa868bcf remote_ip="2001:db8:1::1" revision=a26b0f6c8f96201506c406ca039b46e4fa868bcf span.kind=server system=grpc username=root2148gitlab # [ 255.209686] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.725Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"47a43332a754fb8192405007","created_at":"2026-08-23T16:55:53.399Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.400Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-47a43332a754fb8192405007: start","job_status":"start","queue_duration_s":0.324294,"scheduling_latency_s":0.324308}2149gitlab # [ 255.210209] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"47a43332a754fb8192405007","created_at":"2026-08-23T16:55:53.399Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.400Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-47a43332a754fb8192405007: done: 0.025152 sec","job_status":"done","queue_duration_s":0.324294,"scheduling_latency_s":0.324308,"redis_calls":7,"redis_duration_s":0.003615,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00329,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000325,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025152,"completed_at":"2026-08-23T16:55:53.750Z","load_balancing_strategy":"primary","db_duration_s":0.005066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2150gitlab # [ 255.266861] gitaly[885]: time="2026-08-23T16:55:53.494Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:23.293" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:53.494" grpc.time_ms=0.451 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2151gitlab # [ 255.267596] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.752Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"da45aca302e2ff9a38d3c3e2","created_at":"2026-08-23T16:55:53.442Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.443Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-da45aca302e2ff9a38d3c3e2: start","job_status":"start","queue_duration_s":0.309013,"scheduling_latency_s":0.309029}2152gitlab # [ 255.268162] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.772Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"da45aca302e2ff9a38d3c3e2","created_at":"2026-08-23T16:55:53.442Z","trace_propagation_headers":{"sentry-trace":"ef96032b736f4554a50cf77136b36b89-8a02f321b0ad4910","baggage":"sentry-trace_id=ef96032b736f4554a50cf77136b36b89,sentry-release=Unknown"},"correlation_id":"01M0QRQZXHDZJ87WVQY3VR4QDC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.443Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-da45aca302e2ff9a38d3c3e2: done: 0.020328 sec","job_status":"done","queue_duration_s":0.309013,"scheduling_latency_s":0.309029,"redis_calls":8,"redis_duration_s":0.0017400000000000002,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001311,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020328,"completed_at":"2026-08-23T16:55:53.772Z","load_balancing_strategy":"primary","db_duration_s":0.003823,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2153gitlab # [ 255.305963] gitaly[885]: time="2026-08-23T16:55:53.739Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSN28NSNNDE8F7GX83HYB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:23.638" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:53.738" grpc.time_ms=0.458 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 255.306639] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.773Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"4da472070793520da561d250","created_at":"2026-08-23T16:55:53.470Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-013ea1712db34c74","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.477Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-4da472070793520da561d250: start","job_status":"start","queue_duration_s":0.295729,"scheduling_latency_s":0.295742}2155gitlab # [ 255.341880] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.832Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"4da472070793520da561d250","created_at":"2026-08-23T16:55:53.470Z","trace_propagation_headers":{"sentry-trace":"304a67319e4c474e8aeb39b22c9f5256-013ea1712db34c74","baggage":"sentry-trace_id=304a67319e4c474e8aeb39b22c9f5256,sentry-release=Unknown"},"correlation_id":"01M0QRQV2GA7GVFY9XTCQN45QD","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.477Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-4da472070793520da561d250: done: 0.058615 sec","job_status":"done","queue_duration_s":0.295729,"scheduling_latency_s":0.295742,"redis_calls":11,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213156,"duration_s":0.058615,"completed_at":"2026-08-23T16:55:53.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014321,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2156gitlab # [ 255.377568] gitaly[885]: time="2026-08-23T16:55:53.934Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T16:56:23.833" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:53.933" grpc.time_ms=0.635 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 255.378256] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.833Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"809b04932c8f2ecebd7cc790","created_at":"2026-08-23T16:55:53.495Z","trace_propagation_headers":{"sentry-trace":"a3c1f6d5d44141c9a7dc02f2005c68a7-5bd5f89fe9f642cd","baggage":"sentry-trace_id=a3c1f6d5d44141c9a7dc02f2005c68a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRSMQAMJP5XE3QJY81RF0Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.498Z","job_size_bytes":65,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-809b04932c8f2ecebd7cc790: start","job_status":"start","queue_duration_s":0.334476,"scheduling_latency_s":0.334491}2158gitlab # [ 255.378818] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.851Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"809b04932c8f2ecebd7cc790","created_at":"2026-08-23T16:55:53.495Z","trace_propagation_headers":{"sentry-trace":"a3c1f6d5d44141c9a7dc02f2005c68a7-5bd5f89fe9f642cd","baggage":"sentry-trace_id=a3c1f6d5d44141c9a7dc02f2005c68a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRSMQAMJP5XE3QJY81RF0Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.498Z","job_size_bytes":65,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-809b04932c8f2ecebd7cc790: done: 0.018175 sec","job_status":"done","queue_duration_s":0.334476,"scheduling_latency_s":0.334491,"redis_calls":7,"redis_duration_s":0.000946,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000341,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018175,"completed_at":"2026-08-23T16:55:53.851Z","load_balancing_strategy":"primary","db_duration_s":0.003209,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 255.431316] gitaly[885]: time="2026-08-23T16:55:53.960Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSMQAMJP5XE3QJY81RF0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:23.855" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:53.956" grpc.time_ms=4.138 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 255.431947] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.852Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9264048f705bee912a57ad3a","created_at":"2026-08-23T16:55:53.499Z","trace_propagation_headers":{"sentry-trace":"a3c1f6d5d44141c9a7dc02f2005c68a7-5bd5f89fe9f642cd","baggage":"sentry-trace_id=a3c1f6d5d44141c9a7dc02f2005c68a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRSMQAMJP5XE3QJY81RF0Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.500Z","job_size_bytes":65,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9264048f705bee912a57ad3a: start","job_status":"start","queue_duration_s":0.351637,"scheduling_latency_s":0.351651}2161gitlab # [ 255.436754] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.884Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9264048f705bee912a57ad3a","created_at":"2026-08-23T16:55:53.499Z","trace_propagation_headers":{"sentry-trace":"a3c1f6d5d44141c9a7dc02f2005c68a7-5bd5f89fe9f642cd","baggage":"sentry-trace_id=a3c1f6d5d44141c9a7dc02f2005c68a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRSMQAMJP5XE3QJY81RF0Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.500Z","job_size_bytes":65,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9264048f705bee912a57ad3a: done: 0.031818 sec","job_status":"done","queue_duration_s":0.351637,"scheduling_latency_s":0.351651,"redis_calls":10,"redis_duration_s":0.001459,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031818,"completed_at":"2026-08-23T16:55:53.884Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2162gitlab # [ 255.481370] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.885Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d2a46f6d0040cc0196a86871","created_at":"2026-08-23T16:55:53.534Z","trace_propagation_headers":{"sentry-trace":"a3c1f6d5d44141c9a7dc02f2005c68a7-5bd5f89fe9f642cd","baggage":"sentry-trace_id=a3c1f6d5d44141c9a7dc02f2005c68a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRSMQAMJP5XE3QJY81RF0Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.536Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d2a46f6d0040cc0196a86871: start","job_status":"start","queue_duration_s":0.348649,"scheduling_latency_s":0.348665}2163gitlab # [ 255.487678] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.974Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d2a46f6d0040cc0196a86871","created_at":"2026-08-23T16:55:53.534Z","trace_propagation_headers":{"sentry-trace":"a3c1f6d5d44141c9a7dc02f2005c68a7-5bd5f89fe9f642cd","baggage":"sentry-trace_id=a3c1f6d5d44141c9a7dc02f2005c68a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRSMQAMJP5XE3QJY81RF0Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.536Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d2a46f6d0040cc0196a86871: done: 0.089046 sec","job_status":"done","queue_duration_s":0.348649,"scheduling_latency_s":0.348665,"gitaly_calls":2,"gitaly_duration_s":0.008086,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004782,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000619,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000789,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000215,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001369,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000137,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000321,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000713,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058029,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.063842471,"duration_s":0.089046,"completed_at":"2026-08-23T16:55:53.974Z","load_balancing_strategy":"primary","db_duration_s":0.02151,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2164gitlab # [ 255.532388] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:53.976Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9da7c9a35513145a4a7820d2","created_at":"2026-08-23T16:55:53.922Z","trace_propagation_headers":{"sentry-trace":"a3c1f6d5d44141c9a7dc02f2005c68a7-e8c9efac7d064f3c","baggage":"sentry-trace_id=a3c1f6d5d44141c9a7dc02f2005c68a7,sentry-release=Unknown"},"correlation_id":"01M0QRSMQAMJP5XE3QJY81RF0Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.924Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9da7c9a35513145a4a7820d2: start","job_status":"start","queue_duration_s":0.05202,"scheduling_latency_s":0.052052}2165gitlab # [ 255.574757] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:54.019Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9da7c9a35513145a4a7820d2","created_at":"2026-08-23T16:55:53.922Z","trace_propagation_headers":{"sentry-trace":"a3c1f6d5d44141c9a7dc02f2005c68a7-e8c9efac7d064f3c","baggage":"sentry-trace_id=a3c1f6d5d44141c9a7dc02f2005c68a7,sentry-release=Unknown"},"correlation_id":"01M0QRSMQAMJP5XE3QJY81RF0Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:53.924Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9da7c9a35513145a4a7820d2: done: 0.042856 sec","job_status":"done","queue_duration_s":0.05202,"scheduling_latency_s":0.052052,"redis_calls":7,"redis_duration_s":0.001859,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001309,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042856,"completed_at":"2026-08-23T16:55:54.018Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2166gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a26b0f6c8f96201506c406ca039b46e4fa868bcf/statuses2167gitlab # [ 255.691090] nix-daemon[2844]: accepted connection from pid 3440, user nixbot2168gitlab # [ 255.736429] nix-daemon[2844]: accepted connection from pid 3453, user nixbot2169gitlab # [ 255.751805] nix-daemon[2844]: accepted connection from pid 3440, user nixbot2170gitlab # [ 255.780974] gitaly[885]: time="2026-08-23T16:55:54.868Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSP5SGMK7MP53F8NT5E0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:24.666" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:54.867" grpc.time_ms=0.755 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 255.837674] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a26b0f6c8f96201506c406ca039b46e4fa868bcf/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1142172gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a26b0f6c8f96201506c406ca039b46e4fa868bcf/statuses, in 0.17 seconds)2173gitlab # [ 255.861147] gitaly[885]: time="2026-08-23T16:55:54.948Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:24.846" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:54.947" grpc.time_ms=0.62 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2174gitlab # [ 255.891477] gitaly[885]: time="2026-08-23T16:55:54.978Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:56:04.161" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:54.971" grpc.time_ms=6.604 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 255.926407] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.012Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5c5e3d551827add5b5dd5d7a","created_at":"2026-08-23T16:55:55.006Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-71cd4f89c3f941fe","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.011Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5c5e3d551827add5b5dd5d7a: start","job_status":"start","queue_duration_s":0.001606,"scheduling_latency_s":0.001639}2176gitlab # [ 255.961406] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1762177gitlab # [ 255.967614] nixbot[2628]: {"ts": "2026-08-23T16:55:55.053Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a26b0f6c8f96201506c406ca039b46e4fa868bcf \"HTTP/1.1 201 Created\""}2178gitlab # [ 256.017469] gitaly[885]: time="2026-08-23T16:55:55.103Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSPDKCFX5Y3AH56KW82TQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:25.002" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:55.102" grpc.time_ms=0.612 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 256.060914] gitaly[885]: time="2026-08-23T16:55:55.147Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSPDKCFX5Y3AH56KW82TQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:56:05.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:55.142" grpc.time_ms=5.712 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 256.095255] gitaly[885]: time="2026-08-23T16:55:55.182Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:55.181" grpc.time_ms=0.464 pid=885 span.kind=server system=grpc2181gitlab # [ 256.104550] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1312182gitlab # [ 256.105521] nixbot[2628]: {"ts": "2026-08-23T16:55:55.192Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a26b0f6c8f96201506c406ca039b46e4fa868bcf \"HTTP/1.1 201 Created\""}2183gitlab # [ 256.124368] gitaly[885]: time="2026-08-23T16:55:55.211Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:55.210" grpc.time_ms=0.435 pid=885 span.kind=server system=grpc2184gitlab # [ 256.149020] gitaly[885]: time="2026-08-23T16:55:55.236Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:55.235" grpc.time_ms=0.567 pid=885 span.kind=server system=grpc2185gitlab # [ 256.152064] gitaly[885]: time="2026-08-23T16:55:55.239Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSPJ2MC5DCQ1WSZ4GC9Y7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:25.138" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:55.238" grpc.time_ms=0.482 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab # [ 256.169281] gitaly[885]: time="2026-08-23T16:55:55.256Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:25.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:55.146" operations="[repack_refs]" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2187gitlab # [ 256.171312] gitaly[885]: time="2026-08-23T16:55:55.258Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:25.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:55.146" pid=885 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-23 16:54:52.763674831 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2188gitlab # [ 256.174701] gitaly[885]: time="2026-08-23T16:55:55.261Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 diskcache=e50f4c62-4a18-4286-9b51-a028c128a818 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:25.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:55.146" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 256.175816] gitaly[885]: time="2026-08-23T16:55:55.262Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=93 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7396 command.oublock=0 command.real_time_ms=108 command.spawn_token_fork_ms=15 command.system_time_ms=64 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:25.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:55.146" grpc.time_ms=114.989 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2190gitlab # [ 256.184118] gitaly[885]: time="2026-08-23T16:55:55.271Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:25.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:55.146" pid=885 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2191gitlab # [ 256.184768] gitaly[885]: time="2026-08-23T16:55:55.271Z" level=info msg="optimized repository" clean_stale_data_time=12.475328ms clean_work_trees_time="81.854µs" commit_graph_time="3.352µs" correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.191µs" pid=885 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.912µs" storage_name=default system=housekeeping total_time=12.65943ms2192gitlab # [ 256.185519] gitaly[885]: time="2026-08-23T16:55:55.271Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T16:56:25.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:55.146" pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 256.195753] gitaly[885]: time="2026-08-23T16:55:55.282Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSPJ2MC5DCQ1WSZ4GC9Y7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:56:05.096" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:55:55.276" grpc.time_ms=6.287 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 256.232667] gitaly[885]: time="2026-08-23T16:55:55.314Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T16:56:25.212" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:55.313" grpc.time_ms=0.983 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2195gitlab # [ 256.233252] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a26b0f6c8f96201506c406ca039b46e4fa868bcf HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1152196gitlab # [ 256.233904] nixbot[2628]: {"ts": "2026-08-23T16:55:55.319Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a26b0f6c8f96201506c406ca039b46e4fa868bcf \"HTTP/1.1 201 Created\""}2197gitlab # [ 256.252889] gitaly[885]: time="2026-08-23T16:55:55.339Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:25.238" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:55.339" grpc.time_ms=0.512 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab # [ 256.261967] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.348Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0aed89e937bdb7a54ce0d0ba","created_at":"2026-08-23T16:55:55.346Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"5c5e3d551827add5b5dd5d7a","job_size_bytes":3,"pid":2624,"job_status":"deduplicated","message":"PipelineProcessWorker JID-0aed89e937bdb7a54ce0d0ba: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2199gitlab # [ 256.263319] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.350Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5c5e3d551827add5b5dd5d7a","created_at":"2026-08-23T16:55:55.006Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-71cd4f89c3f941fe","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.011Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2624,"job_status":"rescheduled","message":"PipelineProcessWorker JID-5c5e3d551827add5b5dd5d7a: rescheduled"}2200gitlab # [ 256.269837] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.355Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5c5e3d551827add5b5dd5d7a","created_at":"2026-08-23T16:55:55.006Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-71cd4f89c3f941fe","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.011Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5c5e3d551827add5b5dd5d7a: done: 0.34314 sec","job_status":"done","queue_duration_s":0.001606,"scheduling_latency_s":0.001639,"gitaly_calls":3,"gitaly_duration_s":0.123472,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.013471,"redis_read_bytes":239,"redis_write_bytes":21780,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000805,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001002,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003435,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.005113,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000221,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000592,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001498,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.17316,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.309513081,"duration_s":0.34314,"completed_at":"2026-08-23T16:55:55.355Z","load_balancing_strategy":"primary","db_duration_s":0.035363,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2201gitlab # [ 256.319099] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.357Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3683045f4d57b53110bcab2b","created_at":"2026-08-23T16:55:55.139Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.141Z","job_size_bytes":23,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3683045f4d57b53110bcab2b: start","job_status":"start","queue_duration_s":0.21657,"scheduling_latency_s":0.216594}2202gitlab # [ 256.319635] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.394Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3683045f4d57b53110bcab2b","created_at":"2026-08-23T16:55:55.139Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.141Z","job_size_bytes":23,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3683045f4d57b53110bcab2b: done: 0.036657 sec","job_status":"done","queue_duration_s":0.21657,"scheduling_latency_s":0.216594,"redis_calls":7,"redis_duration_s":0.001287,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036657,"completed_at":"2026-08-23T16:55:55.394Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006343,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2203gitlab # [ 256.357671] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.395Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"42ff344cbb86e7677093a258","created_at":"2026-08-23T16:55:55.270Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.274Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-42ff344cbb86e7677093a258: start","job_status":"start","queue_duration_s":0.121642,"scheduling_latency_s":0.121661}2204gitlab # [ 256.358357] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.421Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"42ff344cbb86e7677093a258","created_at":"2026-08-23T16:55:55.270Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.274Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-42ff344cbb86e7677093a258: done: 0.025732 sec","job_status":"done","queue_duration_s":0.121642,"scheduling_latency_s":0.121661,"redis_calls":7,"redis_duration_s":0.002121,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025732,"completed_at":"2026-08-23T16:55:55.421Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205gitlab # [ 256.383864] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.422Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5a1af3d193ac7f536b32556f","created_at":"2026-08-23T16:55:55.282Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.283Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5a1af3d193ac7f536b32556f: start","job_status":"start","queue_duration_s":0.138996,"scheduling_latency_s":0.139019}2206gitlab # [ 256.396727] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.443Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5a1af3d193ac7f536b32556f","created_at":"2026-08-23T16:55:55.282Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.283Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5a1af3d193ac7f536b32556f: done: 0.021104 sec","job_status":"done","queue_duration_s":0.138996,"scheduling_latency_s":0.139019,"redis_calls":7,"redis_duration_s":0.001003,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021104,"completed_at":"2026-08-23T16:55:55.443Z","load_balancing_strategy":"primary","db_duration_s":0.003067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2207gitlab # [ 256.433045] nix-daemon[2844]: accepted connection from pid 3507, user nixbot2208gitlab # [ 256.433585] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.445Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"14ccd6f51943bd78c9b1c776","created_at":"2026-08-23T16:55:55.290Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.291Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-14ccd6f51943bd78c9b1c776: start","job_status":"start","queue_duration_s":0.153907,"scheduling_latency_s":0.153925}2209gitlab # [ 256.441802] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"14ccd6f51943bd78c9b1c776","created_at":"2026-08-23T16:55:55.290Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.291Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-14ccd6f51943bd78c9b1c776: done: 0.034302 sec","job_status":"done","queue_duration_s":0.153907,"scheduling_latency_s":0.153925,"redis_calls":10,"redis_duration_s":0.010637,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000729,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004808,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034302,"completed_at":"2026-08-23T16:55:55.479Z","load_balancing_strategy":"primary","db_duration_s":0.004572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2210gitlab # [ 256.493617] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.481Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"03b3b862d83163ee24427706","created_at":"2026-08-23T16:55:55.292Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.293Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-03b3b862d83163ee24427706: start","job_status":"start","queue_duration_s":0.187443,"scheduling_latency_s":0.18746}2211gitlab # [ 256.494397] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.498Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"03b3b862d83163ee24427706","created_at":"2026-08-23T16:55:55.292Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.293Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-03b3b862d83163ee24427706: done: 0.017945 sec","job_status":"done","queue_duration_s":0.187443,"scheduling_latency_s":0.18746,"redis_calls":7,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000748,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017945,"completed_at":"2026-08-23T16:55:55.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2212gitlab # [ 256.552758] gitaly[885]: time="2026-08-23T16:55:55.583Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRSPVSMX73AXZXAAZ266PT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:55.575" grpc.time_ms=6.77 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2213gitlab # [ 256.553627] gitaly[885]: time="2026-08-23T16:55:55.633Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSPY169PH94FFNEA03HX3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:55.625" pid=885 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2214gitlab # [ 256.554398] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 702215gitlab # [ 256.554835] gitlab-workhorse[826]: time="2026-08-23T16:55:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672216gitlab # [ 256.555460] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 482217gitlab # [ 256.555955] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fbef073065337f6426707cab","created_at":"2026-08-23T16:55:55.293Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.295Z","job_size_bytes":19,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fbef073065337f6426707cab: start","job_status":"start","queue_duration_s":0.205148,"scheduling_latency_s":0.205163}2218gitlab # [ 256.603341] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.517Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fbef073065337f6426707cab","created_at":"2026-08-23T16:55:55.293Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.295Z","job_size_bytes":19,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fbef073065337f6426707cab: done: 0.016919 sec","job_status":"done","queue_duration_s":0.205148,"scheduling_latency_s":0.205163,"redis_calls":8,"redis_duration_s":0.002964,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001371,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016919,"completed_at":"2026-08-23T16:55:55.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2219gitlab # [ 256.604336] gitaly[885]: time="2026-08-23T16:55:55.633Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSPY169PH94FFNEA03HX3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:55.625" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2220gitlab # [ 256.640472] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.518Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"bc56334531662fde2ece2005","created_at":"2026-08-23T16:55:55.296Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.297Z","job_size_bytes":66,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-bc56334531662fde2ece2005: start","job_status":"start","queue_duration_s":0.221358,"scheduling_latency_s":0.221373}2221gitlab # [ 256.641110] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.533Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"bc56334531662fde2ece2005","created_at":"2026-08-23T16:55:55.296Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.297Z","job_size_bytes":66,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-bc56334531662fde2ece2005: done: 0.01518 sec","job_status":"done","queue_duration_s":0.221358,"scheduling_latency_s":0.221373,"redis_calls":7,"redis_duration_s":0.001604,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000694,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01518,"completed_at":"2026-08-23T16:55:55.533Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001557,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2222gitlab # [ 256.660477] nix-daemon[2844]: accepted connection from pid 3532, user nixbot2223gitlab # [ 256.661159] gitaly[885]: time="2026-08-23T16:55:55.633Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSPY169PH94FFNEA03HX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:55:55.625" grpc.time_ms=7.86 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc2224gitlab # [ 256.672872] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.534Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a940632bcbac623a0faeb188","created_at":"2026-08-23T16:55:55.297Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.298Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a940632bcbac623a0faeb188: start","job_status":"start","queue_duration_s":0.235833,"scheduling_latency_s":0.235847}2225gitlab # [ 256.710071] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a940632bcbac623a0faeb188","created_at":"2026-08-23T16:55:55.297Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.298Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a940632bcbac623a0faeb188: done: 0.025385 sec","job_status":"done","queue_duration_s":0.235833,"scheduling_latency_s":0.235847,"redis_calls":7,"redis_duration_s":0.002821,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025385,"completed_at":"2026-08-23T16:55:55.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2226gitlab # [ 256.718889] gitaly[885]: time="2026-08-23T16:55:55.692Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRSP7QFKFRYW1TS7SH5076 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:55:55.691" grpc.time_ms=0.51 pid=885 span.kind=server system=grpc2227gitlab # [ 256.759639] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.561Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"4d83f834a1043a209ec3d0a7","created_at":"2026-08-23T16:55:55.301Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.303Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4d83f834a1043a209ec3d0a7: start","job_status":"start","queue_duration_s":0.258041,"scheduling_latency_s":0.258056}2228gitlab # [ 256.760434] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.579Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"4d83f834a1043a209ec3d0a7","created_at":"2026-08-23T16:55:55.301Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.303Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4d83f834a1043a209ec3d0a7: done: 0.018378 sec","job_status":"done","queue_duration_s":0.258041,"scheduling_latency_s":0.258056,"redis_calls":7,"redis_duration_s":0.001023,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018378,"completed_at":"2026-08-23T16:55:55.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2229gitlab # [ 256.773644] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.581Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"3b75ae77b153584e5db4c77e","created_at":"2026-08-23T16:55:55.303Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.304Z","job_size_bytes":6,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-3b75ae77b153584e5db4c77e: start","job_status":"start","queue_duration_s":0.277129,"scheduling_latency_s":0.277164}2230gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a26b0f6c8f96201506c406ca039b46e4fa868bcf/statuses2231gitlab # [ 256.786574] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.596Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"3b75ae77b153584e5db4c77e","created_at":"2026-08-23T16:55:55.303Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.304Z","job_size_bytes":6,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-3b75ae77b153584e5db4c77e: done: 0.015178 sec","job_status":"done","queue_duration_s":0.277129,"scheduling_latency_s":0.277164,"redis_calls":7,"redis_duration_s":0.00106,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015178,"completed_at":"2026-08-23T16:55:55.596Z","load_balancing_strategy":"primary","db_duration_s":0.001118,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab # [ 256.820720] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"0f151cd5072b190d6cb95e52","created_at":"2026-08-23T16:55:55.304Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.305Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0f151cd5072b190d6cb95e52: start","job_status":"start","queue_duration_s":0.292187,"scheduling_latency_s":0.292201}2233gitlab # [ 256.855483] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"0f151cd5072b190d6cb95e52","created_at":"2026-08-23T16:55:55.304Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.305Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0f151cd5072b190d6cb95e52: done: 0.018945 sec","job_status":"done","queue_duration_s":0.292187,"scheduling_latency_s":0.292201,"redis_calls":7,"redis_duration_s":0.000956,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018945,"completed_at":"2026-08-23T16:55:55.616Z","load_balancing_strategy":"primary","db_duration_s":0.003753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 256.865281] sidekiq-cluster[2624]: {"severity":"INFO","time":"2026-08-23T16:55:55.617Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"9ed11ff052d4c2e7ea5272ce","created_at":"2026-08-23T16:55:55.350Z","trace_propagation_headers":{"sentry-trace":"6cbf1a9adca64cfb9dc472e35a61540b-6b38acb7ad8f4306","baggage":"sentry-trace_id=6cbf1a9adca64cfb9dc472e35a61540b,sentry-release=Unknown"},"correlation_id":"01M0QRSP7QFKFRYW1TS7SH5076","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T16:55:55.351Z","job_size_bytes":3,"pid":2624,"sidekiq_tid":"m80k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9ed11ff052d4c2e7ea5272ce: start","job_status":"start","queue_duration_s":0.265967,"scheduling_latency_s":0.265982}2235gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a26b0f6c8f96201506c406ca039b46e4fa868bcf/statuses, in 0.08 seconds)2236gitlab # [ 256.904736] gitaly[885]: time="2026-08-23T16:55:55.986Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRSQ9JEHS9FPWV73AQB478 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:56:25.885" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:55:55.985" grpc.time_ms=0.586 pid=885 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2237(finished: subtest: eval and build post commit statuses, in 2.37 seconds)2238(finished: run the VM test script, in 308.24 seconds)2239gitlab # [ 256.920796] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/23:16:55:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a26b0f6c8f96201506c406ca039b46e4fa868bcf/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 522240test script finished in 308.25s2241cleanup2242kill QemuMachine (pid 46)2243gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2244(finished: cleanup, in 1.63 seconds)2245additionally exposed symbols:2246 gitlab,2247 vlan1,2248 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2249[]2250[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-23T16:54:57.372Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2251[]2252[]2253[]2254[]2255[]2256[]2257[]2258[]2259[]2260[]2261[]2262[]2263[]2264[]2265[]2266[]2267[]2268[]2269[]2270[]2271[]2272[]2273[]2274[]2275[]2276[]2277[]2278[]2279[]2280[]2281[]2282[]2283[]2284[]2285[]2286[]2287[]2288[]2289[]2290[]2291[]2292[]2293[]2294[]2295[]2296[]2297[]2298[]2299[]2300[]2301[]2302[]2303[]2304[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'a26b0f6c8f96201506c406ca039b46e4fa868bcf', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-23T16:55:53.315560Z', 'started_at': '2026-08-23T16:55:53.551298Z', 'finished_at': None}]2305[{'id': 5, 'sha': 'a26b0f6c8f96201506c406ca039b46e4fa868bcf', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T16:55:53.528Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2306[{'id': 5, 'sha': 'a26b0f6c8f96201506c406ca039b46e4fa868bcf', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T16:55:53.528Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2307[{'id': 5, 'sha': 'a26b0f6c8f96201506c406ca039b46e4fa868bcf', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-23T16:55:53.528Z', 'started_at': None, 'finished_at': '2026-08-23T16:55:55.000Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'a26b0f6c8f96201506c406ca039b46e4fa868bcf', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-23T16:55:55.171Z', 'started_at': None, 'finished_at': '2026-08-23T16:55:55.298Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]