vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #307
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.ZQAgoGOtL9', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 29187704-b139-4b2a-b71b-58b9e0d5be6516gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20gitlab # Writing inode tables: 0/8 done21gitlab # Creating journal (8192 blocks): done22gitlab # Writing superblocks and filesystem accounting information: 0/8 done23gitlab # 24gitlab # Virtualisation disk image created.25gitlab # Creating Nix store image...26gitlab # Created Nix store image.27(finished: start all VMs, in 52.51 seconds)28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5l86siyizx782icrp7jkk627a91a4pjs-nixos-system-gitlab-test/init regInfo=/nix/store/gmjb3ncn56jbk5g07ni7niyi703q6c3i-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 462507547 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000004] tsc: Detected 2400.010 MHz processor67gitlab # [ 0.000808] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000875] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002731] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002743] Using GB pages for direct mapping73gitlab # [ 0.002814] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002822] ACPI: Early table checksum verification disabled75gitlab # [ 0.002825] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002829] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002833] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002839] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002842] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002843] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002845] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002846] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002848] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002849] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002849] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002850] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002850] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002851] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003080] No NUMA configuration found90gitlab # [ 0.003081] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003084] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005341] Zone ranges:93gitlab # [ 0.005341] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005343] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005344] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005345] Device empty97gitlab # [ 0.005346] Movable zone start for each node98gitlab # [ 0.005346] Early memory node ranges99gitlab # [ 0.005347] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005348] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005349] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005350] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005369] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005634] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.113487] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.113909] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.113924] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.113954] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.113957] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.113959] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.113960] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.113961] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.113962] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.113964] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.113966] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.113971] TSC deadline timer available117gitlab # [ 0.113975] CPU topo: Max. logical packages: 1118gitlab # [ 0.113976] CPU topo: Max. logical dies: 1119gitlab # [ 0.113976] CPU topo: Max. dies per package: 1120gitlab # [ 0.113979] CPU topo: Max. threads per core: 1121gitlab # [ 0.113980] CPU topo: Num. cores per package: 4122gitlab # [ 0.113980] CPU topo: Num. threads per package: 4123gitlab # [ 0.113981] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.114004] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.114021] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.114023] kvm-guest: setup PV sched yield127gitlab # [ 0.114039] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.114041] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.114042] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.114044] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.114045] Booting paravirtualized kernel on KVM132gitlab # [ 0.114049] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.118517] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.120731] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.120779] kvm-guest: PV spinlocks enabled136gitlab # [ 0.120780] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.120783] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5l86siyizx782icrp7jkk627a91a4pjs-nixos-system-gitlab-test/init regInfo=/nix/store/gmjb3ncn56jbk5g07ni7niyi703q6c3i-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.120877] Unknown kernel command line parameters "regInfo=/nix/store/gmjb3ncn56jbk5g07ni7niyi703q6c3i-closure-info/registration", will be passed to user space.139gitlab # [ 0.120891] random: crng init done140gitlab # [ 0.120891] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.129700] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.134210] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.134290] software IO TLB: area num 4.144gitlab # [ 0.208081] Fallback order for Node 0: 0145gitlab # [ 0.208089] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.208091] Policy zone: Normal147gitlab # [ 0.210596] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.220082] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.233840] allocated 12582912 bytes of page_ext150gitlab # [ 0.243688] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.243690] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.244529] Dynamic Preempt: lazy153gitlab # [ 0.244701] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.244702] rcu: RCU event tracing is enabled.155gitlab # [ 0.244702] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.244704] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.244705] Rude variant of Tasks RCU enabled.158gitlab # [ 0.244705] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.244706] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.244707] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.244734] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.244736] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.244737] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.249033] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.249327] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.249335] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.249445] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.253004] Console: colour VGA+ 80x25169gitlab # [ 0.253007] printk: legacy console [tty0] enabled170gitlab # [ 0.283417] printk: legacy console [ttyS0] enabled171gitlab # [ 0.391153] ACPI: Core revision 20250807172gitlab # [ 0.392141] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.393763] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.394813] x2apic enabled175gitlab # [ 0.395561] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.396518] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.397791] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.399294] kvm-guest: setup PV IPIs179gitlab # [ 0.400862] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.401935] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns181gitlab # [ 0.403695] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010)182gitlab # [ 0.405778] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.406817] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.408692] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.409696] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.410693] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.411693] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.412692] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.413693] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.414692] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.416699] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.417464] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.418693] active return thunk: srso_alias_return_thunk194gitlab # [ 0.419714] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.420692] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.422517] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.423513] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.424693] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.425692] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.426692] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.427693] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.428692] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.429693] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.430693] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.431692] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.433499] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.462576] Freeing SMP alternatives memory: 44K208gitlab # [ 0.463310] pid_max: default: 32768 minimum: 301209gitlab # [ 0.463819] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.465594] landlock: Up and running.211gitlab # [ 0.466180] Yama: becoming mindful.212gitlab # [ 0.466910] LSM support for eBPF active213gitlab # [ 0.467921] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.468840] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.472068] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.473281] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.473701] ... version: 2218gitlab # [ 0.474461] ... bit width: 48219gitlab # [ 0.474695] ... generic counters: 6220gitlab # [ 0.475430] ... generic bitmap: 000000000000003f221gitlab # [ 0.475695] ... fixed-purpose counters: 0222gitlab # [ 0.476444] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.476695] ... value mask: 0000ffffffffffff224gitlab # [ 0.477653] ... max period: 00007fffffffffff225gitlab # [ 0.478453] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.478796] signal: max sigframe size: 3376227gitlab # [ 0.479671] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.480338] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.480901] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.486192] smp: Bringing up secondary CPUs ...231gitlab # [ 0.487382] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.487703] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.490828] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.492460] smpboot: Total of 4 processors activated (19200.08 BogoMIPS)235gitlab # [ 0.493830] Memory: 6011372K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.495695] devtmpfs: initialized237gitlab # [ 0.496543] x86/mm: Memory block size: 128MB238gitlab # [ 0.499760] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.500775] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.501801] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.502942] PM: RTC time: 06:40:26, date: 2026-09-04242gitlab # [ 0.506631] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.508917] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.509749] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.511802] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.512706] audit: initializing netlink subsys (disabled)247gitlab # [ 0.513750] audit: type=2000 audit(1788504027.692:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.514020] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.515696] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.516695] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.517695] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.518694] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.519711] cpuidle: using governor menu254gitlab # [ 0.521896] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.522951] PCI: Using configuration type 1 for base access256gitlab # [ 0.523696] PCI: Using configuration type 1 for extended access257gitlab # [ 0.524822] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.527904] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.528696] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.529695] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.530695] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.536021] ACPI: Added _OSI(Module Device)263gitlab # [ 0.537704] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.539704] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.546667] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.552480] ACPI: Interpreter enabled267gitlab # [ 0.554755] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.556703] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.558855] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.562702] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.565049] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.577652] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.579747] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.583358] acpiphp: Slot [3] registered275gitlab # [ 0.584738] acpiphp: Slot [4] registered276gitlab # [ 0.586739] acpiphp: Slot [5] registered277gitlab # [ 0.587775] acpiphp: Slot [6] registered278gitlab # [ 0.589740] acpiphp: Slot [7] registered279gitlab # [ 0.590737] acpiphp: Slot [8] registered280gitlab # [ 0.591755] acpiphp: Slot [9] registered281gitlab # [ 0.593748] acpiphp: Slot [10] registered282gitlab # [ 0.595191] acpiphp: Slot [11] registered283gitlab # [ 0.596786] acpiphp: Slot [12] registered284gitlab # [ 0.598757] acpiphp: Slot [13] registered285gitlab # [ 0.600775] acpiphp: Slot [14] registered286gitlab # [ 0.602753] acpiphp: Slot [15] registered287gitlab # [ 0.604751] acpiphp: Slot [16] registered288gitlab # [ 0.605749] acpiphp: Slot [17] registered289gitlab # [ 0.607772] acpiphp: Slot [18] registered290gitlab # [ 0.609764] acpiphp: Slot [19] registered291gitlab # [ 0.611750] acpiphp: Slot [20] registered292gitlab # [ 0.612748] acpiphp: Slot [21] registered293gitlab # [ 0.614770] acpiphp: Slot [22] registered294gitlab # [ 0.616751] acpiphp: Slot [23] registered295gitlab # [ 0.618749] acpiphp: Slot [24] registered296gitlab # [ 0.619748] acpiphp: Slot [25] registered297gitlab # [ 0.621770] acpiphp: Slot [26] registered298gitlab # [ 0.623752] acpiphp: Slot [27] registered299gitlab # [ 0.625761] acpiphp: Slot [28] registered300gitlab # [ 0.626769] acpiphp: Slot [29] registered301gitlab # [ 0.628752] acpiphp: Slot [30] registered302gitlab # [ 0.630749] acpiphp: Slot [31] registered303gitlab # [ 0.632791] PCI host bridge to bus 0000:00304gitlab # [ 0.634729] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.636702] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.639701] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.642700] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.644698] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.647718] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.650346] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.653781] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.657576] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.662702] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.663770] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.664700] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.665695] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.666697] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.668293] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.672198] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.677250] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.681398] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.683736] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.687333] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.708809] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.709708] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.711717] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.712864] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.714469] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.718730] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.719667] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.720519] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.733703] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.736116] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.742735] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.744712] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.746756] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.754491] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.762717] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.765717] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.767755] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.774114] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.782722] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.785716] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.787773] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.794971] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.802740] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.804714] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.806755] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.809405] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.814726] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.815646] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.816524] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.819738] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.823740] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.824706] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.825717] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.826702] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.829400] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.833735] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.834717] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.836948] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.841733] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.842652] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.844484] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.846928] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.850729] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.852702] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.853717] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.858449] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.859860] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.860835] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.862837] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.863785] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.866783] iommu: Default domain type: Translated375gitlab # [ 0.867698] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.868954] ACPI: bus type USB registered377gitlab # [ 0.869758] usbcore: registered new interface driver usbfs378gitlab # [ 0.870704] usbcore: registered new interface driver hub379gitlab # [ 0.871605] usbcore: registered new device driver usb380gitlab # [ 0.873782] NetLabel: Initializing381gitlab # [ 0.874548] NetLabel: domain hash size = 128382gitlab # [ 0.875277] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.876740] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.877697] PCI: Using ACPI for IRQ routing385gitlab # [ 0.878891] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.879691] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.879691] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.881699] vgaarb: loaded389gitlab # [ 0.882448] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.883695] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.888786] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.892067] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.892845] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.894337] pnp: PnP ACPI init395gitlab # [ 0.895515] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.905455] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.907048] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.908112] NET: Registered PF_INET protocol family399gitlab # [ 0.910185] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.927944] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.929512] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.930949] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.934660] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.936032] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.937220] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.938590] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.940068] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.941465] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.942518] NET: Registered PF_XDP protocol family410gitlab # [ 0.943434] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.944525] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.945600] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.946776] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.947955] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.949334] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.950389] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.952817] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.955397] PCI: CLS 0 bytes, default 64419gitlab # [ 0.956168] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.957035] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.957351] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.960180] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns423gitlab # [ 0.980968] Initialise system trusted keyrings424gitlab # [ 0.982229] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.993974] Key type asymmetric registered426gitlab # [ 0.994771] Asymmetric key parser 'x509' registered427gitlab # [ 0.995695] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.997296] io scheduler mq-deadline registered429gitlab # [ 0.998100] io scheduler kyber registered430gitlab # [ 1.002857] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.004239] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.007016] Linux agpgart interface v0.103433gitlab # [ 1.007860] ACPI: bus type drm_connector registered434gitlab # [ 1.010800] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.011938] usbserial: USB Serial support registered for generic436gitlab # [ 1.012979] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.012979] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.015356] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.016834] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.018042] NET: Registered PF_INET6 protocol family441gitlab # [ 1.019827] Segment Routing with IPv6442gitlab # [ 1.020562] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.022628] IPI shorthand broadcast: enabled444gitlab # [ 1.026971] sched_clock: Marking stable (880011425, 146356987)->(1047940773, -21572361)445gitlab # [ 1.028824] registered taskstats version 1446gitlab # [ 1.029936] Loading compiled-in X.509 certificates447gitlab # [ 1.040178] Demotion targets for Node 0: null448gitlab # [ 1.041287] Key type .fscrypt registered449gitlab # [ 1.042000] Key type fscrypt-provisioning registered450gitlab # [ 1.042994] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.043963] ima: Allocated hash algorithm: sha1452gitlab # [ 1.044825] ima: No architecture policies found453gitlab # [ 1.045975] PM: Magic number: 10:86:670454gitlab # [ 1.047641] RAS: Correctable Errors collector initialized.455gitlab # [ 1.052092] clk: Disabling unused clocks456gitlab # [ 1.052815] PM: genpd: Disabling unused power domains457gitlab # [ 1.245175] Freeing initrd memory: 29392K458gitlab # [ 1.248981] Freeing unused decrypted memory: 2028K459gitlab # [ 1.251734] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.252891] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.256738] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.260606] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.328871] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.330052] Run /init as init process465gitlab # [ 1.341493] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.365115] fuse: init (API version 7.45)467gitlab # [ 1.373537] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.380265] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.383735] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.421853] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.757953] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.798592] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.800803] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.803016] systemd[1]: Running in initrd.475gitlab # [ 1.805260] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.807863] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.920796] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.961918] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.974988] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.976189] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.977675] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.978864] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.980014] systemd[1]: Reached target Path Units.484gitlab # [ 1.980933] systemd[1]: Reached target Slice Units.485gitlab # [ 1.981855] systemd[1]: Reached target Swaps.486gitlab # [ 1.982744] systemd[1]: Reached target Timer Units.487gitlab # [ 1.983754] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.985016] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.986153] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.987193] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.988202] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.989156] systemd[1]: Reached target Socket Units.493gitlab # [ 1.991270] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.993331] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.995393] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 1.998228] systemd[1]: Starting Journal Service...497gitlab # [ 2.002443] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.004241] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.014484] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.023476] systemd-journald[90]: Collecting audit messages is disabled.501gitlab # [ 2.027021] systemd[1]: Finished Create List of Static Device Nodes.502gitlab # [ 2.038351] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.047168] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 2.049999] netfs: FS-Cache loaded505gitlab # [ 2.051094] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config506gitlab # [ 2.058324] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.058541] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...508gitlab # [ 2.058969] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev509gitlab # [ 2.069195] 9pnet: Installing 9P2000 support510gitlab # [ 2.074741] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 2.077505] systemd[1]: Starting Apply Kernel Variables...512gitlab # [ 2.080799] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.513gitlab # [ 2.082552] systemd[1]: Finished Load Kernel Module 9pnet_virtio.514gitlab # [ 2.085858] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.515gitlab # [ 2.088577] systemd[1]: Starting Create Static Device Nodes in /dev...516gitlab # [ 1.942240] systemd-modules-load[92]: Using 4 probe threads517gitlab # [ 2.089972] systemd[1]: Started Journal Service.518gitlab # [ 1.945044] systemd-modules-load[92]: Inserted module 'virtio_balloon'519gitlab # [ 1.946409] systemd-modules-load[92]: Inserted module 'dm_mod'520gitlab # [ 1.947848] systemd-modules-load[92]: Inserted module 'virtio_gpu'521gitlab # [ 1.955529] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 1.962499] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.963470] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.964393] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.965178] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.966100] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.981604] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.990174] systemd-udevd[113]: Using default interface naming scheme 'v261'.529gitlab # [ 2.000233] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.017380] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.018182] systemd[1]: Reached target System Initialization.532gitlab # [ 2.018978] systemd[1]: Reached target Basic System.533gitlab # [ 2.242098] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.243738] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.244873] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.245713] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140537gitlab # [ 2.246815] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18538gitlab # [ 2.248049] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1539gitlab # [ 2.249101] usb usb1: Product: UHCI Host Controller540gitlab # [ 2.249982] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd541gitlab # [ 2.250904] usb usb1: SerialNumber: 0000:00:01.2542gitlab # [ 2.252408] hub 1-0:1.0: USB hub found543gitlab # [ 2.253020] hub 1-0:1.0: 2 ports detected544gitlab # [ 2.267829] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12545gitlab # [ 2.267893] SCSI subsystem initialized546gitlab # [ 2.270258] serio: i8042 KBD port at 0x60,0x64 irq 1547gitlab # [ 2.271723] virtio_blk virtio4: 4/0/0 default/read/poll queues548gitlab # [ 2.276513] serio: i8042 AUX port at 0x60,0x64 irq 12549gitlab # [ 2.285063] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)550gitlab # [ 2.301703] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.308078] virtio_blk virtio5: [vdb] 11842936 512-byte logical blocks (6.06 GB/5.65 GiB)552gitlab # [ 2.310892] scsi host0: ata_piix553gitlab # [ 2.321947] scsi host1: ata_piix554gitlab # [ 2.323386] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.324556] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.179292] systemd[1]: Starting Virtual Console Setup...557gitlab # [ 2.187542] (udev-worker)[140]: Network interface NamePolicy= disabled on kernel command line.558gitlab # [ 2.190690] (udev-worker)[125]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.559gitlab # [ 2.193350] (udev-worker)[125]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.200144] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.205127] systemd[1]: Found device /dev/disk/by-label/nix-store.562gitlab # [ 2.206230] systemd[1]: Reached target Initrd Root Device.563gitlab # [ 2.207921] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...564gitlab # [ 2.209782] systemd-vconsole-setup[149]: Configuration of first virtual console was skipped, ignoring remaining ones.565gitlab # [ 2.211434] systemd[1]: Finished Virtual Console Setup.566gitlab # [ 2.234537] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.238396] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.476567] usb 1-1: new full-speed USB device number 2 using uhci_hcd569gitlab # [ 2.484960] ata2: found unknown device (class 0)570gitlab # [ 2.487717] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571gitlab # [ 2.491864] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572gitlab # [ 2.516520] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573gitlab # [ 2.559892] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.588082] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.645534] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.648560] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.651157] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.652837] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.654320] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.687113] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.700112] usbcore: registered new interface driver usbhid582gitlab # [ 2.702735] usbhid: USB HID core driver583gitlab # [ 2.713193] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.717421] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.872965] systemd[1]: Mounting /sysroot...586gitlab # [ 3.171593] EXT4-fs (vda): mounted filesystem 29187704-b139-4b2a-b71b-58b9e0d5be65 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.030260] systemd[1]: Mounted /sysroot.588gitlab # [ 3.032432] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.037687] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.041379] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.051270] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.053780] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.057461] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.060763] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.068746] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.073908] systemd[1]: Mounted /sysroot/run.597gitlab # [ 3.221953] erofs (device vdb): mounted with root inode @ nid 128.598gitlab # [ 3.079145] systemd[1]: Starting rw-sysroot-nix-store.service...599gitlab # [ 3.082973] systemd[1]: Mounted /sysroot/nix/.ro-store.600gitlab # [ 3.231133] 9p: Installing v9fs 9p2000 file system support601gitlab # [ 3.086286] systemd-sysroot-fstab-check[178]: /sysroot should be mounted in the initrd, will request daemon-reload.602gitlab # [ 3.088313] systemd[1]: Reload requested from client PID 178 ('systemd-sysroot') (unit initrd-parse-etc.service)...603gitlab # [ 3.090333] systemd[1]: Reloading...604gitlab # [ 3.148148] systemd[1]: Reloading finished in 61 ms.605gitlab # [ 3.178680] systemd-sysroot-fstab-check[178]: Requesting initrd-fs.target/start/replace...606gitlab # [ 3.181569] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.183361] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.185053] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.187484] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.189613] systemd-sysroot-fstab-check[178]: Requesting swap.target/start/replace...611gitlab # [ 3.192214] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.194242] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.196617] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.198910] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.206879] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.209280] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.873830] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.921882] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.923854] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.925904] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.927824] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.958337] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.960929] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.982423] systemd[1]: Finished Find NixOS closure.625gitlab # [ 3.984344] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 3.986386] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.015295] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.017504] systemd[1]: Stopped target Basic System.629gitlab # [ 4.019398] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.021409] systemd[1]: Stopped target Path Units.631gitlab # [ 4.023222] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.025777] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.028456] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.030709] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.032680] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.034982] systemd[1]: Stopped target Swaps.637gitlab # [ 4.037437] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.039708] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.042371] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.044721] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.047589] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.049637] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.053894] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.056266] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.058762] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.060843] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.062853] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.064335] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.066422] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.068552] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.070705] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.072480] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.073997] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.075837] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.077813] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.079227] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.080266] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.081316] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.082106] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.083077] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.083972] systemd[1]: systemd-udevd.service: Deactivated successfully.662gitlab # [ 4.084845] systemd[1]: Stopped Rule-based Manager for Device Events and Files.663gitlab # [ 4.085813] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.664gitlab # [ 4.086794] systemd[1]: Finished rw-sysroot-nix-store.service.665gitlab # [ 4.087688] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.088723] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.089541] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.090366] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.091394] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.092311] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.093409] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.094380] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.095361] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.096265] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.097378] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.098189] systemd[1]: Reached target Switch Root.677gitlab # [ 4.098927] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.206413] initrd-nixos-activation-start[228]: booting system configuration /nix/store/5l86siyizx782icrp7jkk627a91a4pjs-nixos-system-gitlab-test679gitlab # [ 4.247355] initrd-nixos-activation-start[228]: running activation script...680gitlab # [ 4.480195] initrd-nixos-activation-start[251]: setting up /etc...681gitlab # [ 4.594753] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.597507] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.599344] systemd[1]: Starting Switch Root...684gitlab # [ 4.617467] systemd[1]: Switching root.685gitlab # [ 4.821953] systemd-journald[90]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.930414] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.302026] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.312072] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.313941] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.315909] systemd[1]: Detected first boot.691gitlab # [ 5.318480] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.458926] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.547584] systemd[1]: Applying preset policy.694gitlab # [ 5.730536] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.843339] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.844734] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.846769] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.849055] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.850450] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.851899] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.852991] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.854241] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.855382] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.856116] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.856878] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.857787] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.858618] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.859483] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.860409] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.861335] systemd[1]: Reached target Path Units.711gitlab # [ 5.862142] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.862960] systemd[1]: Reached target Slice Units.713gitlab # [ 5.863691] systemd[1]: Reached target Swaps.714gitlab # [ 5.865113] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.867094] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.868444] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.870073] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.870990] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.873195] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.874632] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.876327] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.877488] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.878650] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.880063] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.882741] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.883871] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.884845] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.887725] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.889968] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.891959] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.895633] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.906852] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.908002] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.911831] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.912755] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.914209] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.915914] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.935437] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.936446] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.944469] systemd[1]: Starting Journal Service...741gitlab # [ 5.948489] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.952125] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.963165] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.964115] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 5.968431] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 5.971188] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 5.972922] systemd[1]: Mounted Huge Pages File System.748gitlab # [ 5.973902] systemd[1]: Mounted POSIX Message Queue File System.749gitlab # [ 5.974968] systemd[1]: Mounted Kernel Debug File System.750gitlab # [ 5.975946] systemd[1]: Mounted Kernel Trace File System.751gitlab # [ 5.980701] systemd[1]: Finished Create List of Static Device Nodes.752gitlab # [ 5.981963] systemd[1]: modprobe@configfs.service: Deactivated successfully.753gitlab # [ 5.983459] systemd[1]: Finished Load Kernel Module configfs.754gitlab # [ 5.984536] systemd[1]: Mounted FUSE Control File System.755gitlab # [ 5.986906] systemd[1]: Mounting Kernel Configuration File System...756gitlab # [ 5.991710] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...757gitlab # [ 5.996303] systemd-journald[323]: Collecting audit messages is enabled.758gitlab # [ 5.998841] loop: module loaded759gitlab # [ 6.000024] EXT4-fs (vda): re-mounted 29187704-b139-4b2a-b71b-58b9e0d5be65.760gitlab # [ 6.006173] systemd[1]: Finished Remount Root and Kernel File Systems.761gitlab # [ 6.010038] systemd[1]: Finished Load Kernel Modules.762gitlab # [ 6.012606] systemd[1]: Listening on Disk Image Download Service Socket.763gitlab # [ 6.014677] systemd[1]: Starting Firewall...764gitlab # [ 5.869072] systemd[1]: Queued start job for default target Multi-User System.765gitlab # [ 5.870467] systemd[1]: Unnec[ 6.016550] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore766gitlab # essary job was removed for /dev/vdb.767gitlab # [ 5.873146] systemd[1]: systemd-journald.service: Deactivated successfully.768gitlab # [ 5.874467] systemd-modules-load[324]: Using 3 probe threads769gitlab # [ 5.875529] systemd-modules-load[324]: Inserted module 'loop'770gitlab # [ 5.876510] systemd-modules-load[324]: Inserted module 'tls'771gitlab # [ 5.877676] systemd-oomd[325]: No swap; memory pressure usage will be degraded772gitlab # [ 6.026456] systemd[1]: Starting Load/Save OS Random Seed...773gitlab # [ 6.036505] systemd[1]: Starting Apply Kernel Variables...774gitlab # [ 6.037516] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os775gitlab # [ 6.041110] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.776gitlab # [ 6.042326] systemd[1]: Started Journal Service.777gitlab # [ 5.898055] systemd[1]: Mounted Kernel Configuration File System.778gitlab # [ 5.899617] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.779gitlab # [ 5.905351] systemd[1]: Finished Load/Save OS Random Seed.780gitlab # [ 5.906750] systemd[1]: Finished Apply Kernel Variables.781gitlab # [ 5.912072] systemd[1]: Reached target First Boot Complete.782gitlab # [ 5.913425] systemd[1]: Starting Flush Journal to Persistent Storage...783gitlab # [ 5.916306] systemd[1]: Starting Create Static Device Nodes in /dev...784gitlab # [ 6.073883] systemd-journald[323]: Received client request to flush runtime journal.785gitlab # [ 5.969082] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 5.970244] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 5.971385] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 5.974862] systemd-udevd[365]: Using default interface naming scheme 'v261'.789gitlab # [ 5.975954] systemd[1]: Finished Flush Journal to Persistent Storage.790gitlab # [ 5.985676] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 5.987215] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.050141] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.074970] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.096756] (udev-worker)[427]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.795gitlab # [ 6.098934] (udev-worker)[427]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.117770] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.797gitlab # [ 6.118869] systemd[1]: Condition check resulted in Virtio network device being skipped.798gitlab # [ 6.120161] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore799gitlab # [ 6.121639] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67800gitlab # [ 6.123699] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore801gitlab # [ 6.125374] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os802gitlab # [ 6.126655] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.128138] (udev-worker)[422]: Network interface NamePolicy= disabled on kernel command line.804gitlab # [ 6.298112] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3805gitlab # [ 6.173826] systemd[1]: Finished Firewall.806gitlab # [ 6.325438] parport_pc 00:03: reported by Plug and Play ACPI807gitlab # [ 6.326372] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]808gitlab # [ 6.329629] rtc_cmos 00:05: RTC can wake from S4809gitlab # [ 6.331636] mousedev: PS/2 mouse device common for all mice810gitlab # [ 6.335037] ACPI: button: Power Button [PWRF]811gitlab # [ 6.340157] Floppy drive(s): fd0 is 2.88M AMI BIOS812gitlab # [ 6.341158] rtc_cmos 00:05: registered as rtc0813gitlab # [ 6.341956] rtc_cmos 00:05: setting system clock to 2026-09-04T06:40:32 UTC (1788504032)814gitlab # [ 6.343508] systemd-journald[323]: Time jumped backwards, rotating.815gitlab # [ 6.345051] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs816gitlab # [ 6.349960] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console817gitlab # [ 6.352016] FDC 0 is a S82078B818gitlab # [ 6.365832] Console: switching to colour dummy device 80x25819gitlab # [ 6.371146] [drm] Found bochs VGA, ID 0xb0c5.820gitlab # [ 6.371148] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.821gitlab # [ 6.373224] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic822gitlab # [ 6.374151] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0823gitlab # [ 6.376427] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5824gitlab # [ 6.379266] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0825gitlab # [ 6.379317] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4826gitlab # [ 6.381460] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD827gitlab # [ 6.387951] Console: switching to colour frame buffer device 160x50828gitlab # [ 6.390495] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device829gitlab # [ 6.392717] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6830gitlab # [ 6.309783] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.329743] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.348158] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.361323] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.518521] ppdev: user-space parallel port driver835gitlab # [ 6.572508] kvm_amd: TSC scaling supported836gitlab # [ 6.572985] kvm_amd: Nested Virtualization enabled837gitlab # [ 6.573585] kvm_amd: Nested Paging enabled838gitlab # [ 6.574093] kvm_amd: LBR virtualization supported839gitlab # [ 6.574677] kvm_amd: Virtual VMLOAD VMSAVE supported840gitlab # [ 6.575257] kvm_amd: Virtual GIF supported841gitlab # [ 6.575737] kvm_amd: Virtual NMI enabled842gitlab # [ 6.436605] systemd-vconsole-setup[497]: Configuration of first virtual console was skipped, ignoring remaining ones.843gitlab # [ 6.440807] systemd[1]: Finished Virtual Console Setup.844gitlab # [ 6.610259] EDAC MC: Ver: 3.0.0845gitlab # [ 6.701689] systemd[1]: Mounting /run/wrappers...846gitlab # [ 6.723974] systemd[1]: Mounted /run/wrappers.847gitlab # [ 6.725826] systemd[1]: Reached target Local File Systems.848gitlab # [ 6.727901] systemd[1]: Listening on Boot Loader Control Service Socket.849gitlab # [ 6.730328] systemd[1]: Starting register-nix-paths.service...850gitlab # [ 6.732463] systemd[1]: Starting Create SUID/SGID Wrappers...851gitlab # [ 6.734485] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852gitlab # [ 6.737574] systemd[1]: Starting Save Transient machine-id to Disk...853gitlab # [ 6.743226] systemd[1]: Starting Create System Files and Directories...854gitlab # [ 6.772463] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.855gitlab # [ 6.776367] systemd[1]: Finished Save Transient machine-id to Disk.856gitlab # [ 6.787854] systemd[1]: Finished Create System Files and Directories.857gitlab # [ 6.790288] systemd[1]: Starting Rebuild Journal Catalog...858gitlab # [ 6.792157] systemd[1]: Starting Record System Boot/Shutdown in UTMP...859gitlab # [ 6.812845] systemd[1]: Finished Record System Boot/Shutdown in UTMP.860gitlab # [ 6.825582] systemd[1]: Finished Rebuild Journal Catalog.861gitlab # [ 6.827125] systemd[1]: Starting Update is Completed...862gitlab # [ 6.841445] systemd[1]: Finished Update is Completed.863gitlab # [ 6.891146] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.864gitlab # [ 6.893268] systemd[1]: Finished Create SUID/SGID Wrappers.865gitlab # [ 7.116469] systemd[1]: Finished register-nix-paths.service.866gitlab # [ 7.118764] systemd[1]: Reached target System Initialization.867gitlab # [ 7.120868] systemd[1]: Started Discard unused filesystem blocks once a week.868gitlab # [ 7.123502] systemd[1]: Started logrotate.timer.869gitlab # [ 7.125338] systemd[1]: Started Daily Cleanup of Temporary Directories.870gitlab # [ 7.127681] systemd[1]: Reached target Timer Units.871gitlab # [ 7.129590] systemd[1]: Listening on D-Bus System Message Bus Socket.872gitlab # [ 7.131869] systemd[1]: Listening on Nix Daemon Socket.873gitlab # [ 7.133831] systemd[1]: Starting nixbot CI service socket...874gitlab # [ 7.135920] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.875gitlab # [ 7.138886] systemd[1]: Starting D-Bus System Message Bus...876gitlab # [ 7.140963] systemd[1]: Listening on nixbot CI service socket.877gitlab # [ 7.143165] systemd[1]: Reached target Socket Units.878gitlab # [ 7.189351] dbus-broker-launch[579]: Looking up NSS user entry for 'systemd-timesync'...879gitlab # [ 7.192548] dbus-broker-launch[579]: NSS returned no entry for 'systemd-timesync'880gitlab # [ 7.195521] dbus-broker-launch[579]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"881gitlab # [ 7.201220] systemd[1]: Started D-Bus System Message Bus.882gitlab # [ 7.216606] dbus-broker-launch[579]: Ready883gitlab # [ 7.219695] systemd[1]: Reached target Basic System.884gitlab # [ 7.222544] systemd[1]: Started backdoor.service.885gitlab # [ 7.225167] systemd[1]: Starting gitlab-config.service...886gitlab # [ 7.227767] systemd[1]: Starting Import lastlog data into lastlog2 database...887gitlab # [ 7.233501] systemd[1]: Starting Logrotate configuration check...888gitlab # [ 7.243560] systemd[1]: Starting Name Service Cache Daemon (nsncd)...889gitlab # [ 7.250868] systemd[1]: Starting Post-Boot Actions...890gitlab # [ 7.254587] systemd[1]: Started Reset console on configuration changes.891gitlab # [ 7.257920] logrotate[584]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.892gitlab # [ 7.263236] logrotate[584]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf893gitlab # connecting to host...894gitlab # [ 7.265549] logrotate[584]: note: 'monthly' overrides previously specified 'weekly'895gitlab # [ 7.266582] logrotate[584]: Reading state from file: /var/lib/logrotate.status896gitlab # [ 7.267855] logrotate[584]: state file /var/lib/logrotate.status does not exist897gitlab # [ 7.268789] logrotate[584]: Allocating hash table for state file, size 64 entries898gitlab # [ 7.269816] logrotate[584]: Handling 4 logs899gitlab # [ 7.270801] logrotate[584]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed900gitlab # [ 7.272149] logrotate[584]: considering log /var/log/btmp901gitlab: Guest shell says: b'Spawning backdoor root shell...\n'902gitlab # [ 7.272837] logrotate[584]: Creating new state903gitlab: connected to guest root shell904gitlab # [ 7.273773] logrotate[584]: Now: 2026-09-04 06:40905gitlab: (connecting took 7.90 seconds)906gitlab # [ 7.274734] logrotate[584]: Last rotated at 2026-09-04 06:00907gitlab: (finished: waiting for the VM to finish booting, in 7.90 seconds)908gitlab # [ 7.277949] logrotate[584]: log does not need rotating (log has already been rotated)909gitlab # [ 7.278823] logrotate[584]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed910gitlab # [ 7.279887] logrotate[584]: considering log /var/log/wtmp911gitlab # [ 7.281627] logrotate[584]: Creating new state912gitlab # [ 7.284076] logrotate[584]: Now: 2026-09-04 06:40913gitlab # [ 7.284616] logrotate[584]: Last rotated at 2026-09-04 06:00914gitlab # [ 7.285087] logrotate[584]: log does not need rotating (log has already been rotated)915gitlab # [ 7.285522] logrotate[584]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed916gitlab # [ 7.285986] logrotate[584]: switching euid from 0 to 165 and egid from 0 to 165 (pid 584)917gitlab # [ 7.286738] logrotate[584]: considering log /var/gitlab/state/log/*.log918gitlab # [ 7.287188] logrotate[584]: log /var/gitlab/state/log/*.log does not exist -- skipping919gitlab # [ 7.287620] logrotate[584]: Creating new state920gitlab # [ 7.288088] logrotate[584]: switching euid from 165 to 0 and egid from 165 to 0 (pid 584)921gitlab # [ 7.288528] logrotate[584]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed922gitlab # [ 7.288971] logrotate[584]: switching euid from 0 to 60 and egid from 0 to 60 (pid 584)923gitlab # [ 7.295539] logrotate[584]: considering log /var/log/nginx/*.log924gitlab # [ 7.296057] logrotate[584]: log /var/log/nginx/*.log does not exist -- skipping925gitlab # [ 7.296510] logrotate[584]: Creating new state926gitlab # [ 7.297040] logrotate[584]: not running postrotate script, since no logs were rotated927gitlab # [ 7.297496] logrotate[584]: switching euid from 60 to 0 and egid from 60 to 0 (pid 584)928gitlab # [ 7.302260] systemd[1]: Starting resolvconf update...929gitlab # [ 7.303217] systemd[1]: Finished Logrotate configuration check.930gitlab # [ 7.304221] systemd[1]: Finished Post-Boot Actions.931gitlab # [ 7.311944] systemd[1]: Finished Import lastlog data into lastlog2 database.932gitlab # [ 7.328516] nsncd[585]: Sep 04 06:40:33.632 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"933gitlab # [ 7.330748] systemd[1]: Started Name Service Cache Daemon (nsncd).934gitlab # [ 7.331711] systemd[1]: Reached target Host and Network Name Lookups.935gitlab # [ 7.332903] systemd[1]: Reached target User and Group Name Lookups.936gitlab # [ 7.333570] systemd[1]: Starting User Login Management...937gitlab # [ 7.348884] systemd[1]: Stopped target Host and Network Name Lookups.938gitlab # [ 7.349928] systemd[1]: Stopping Host and Network Name Lookups...939gitlab # [ 7.350543] systemd[1]: Stopped target User and Group Name Lookups.940gitlab # [ 7.351073] systemd[1]: Stopping User and Group Name Lookups...941gitlab # [ 7.353122] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...942gitlab # [ 7.355570] systemd[1]: nscd.service: Deactivated successfully.943gitlab # [ 7.357092] systemd[1]: Stopped Name Service Cache Daemon (nsncd).944gitlab # [ 7.357885] systemd[1]: nscd.service: Consumed 19ms CPU time over 111ms wall clock time, 7.1M memory peak, 5.5M read from disk.945gitlab # [ 7.361568] systemd[1]: Starting Name Service Cache Daemon (nsncd)...946gitlab # [ 7.371601] systemd-logind[650]: New seat seat0.947gitlab # [ 7.373907] systemd-logind[650]: Watching system buttons on /dev/input/event2 (Power Button)948gitlab # [ 7.374822] systemd-logind[650]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)949gitlab # [ 7.376275] systemd-logind[650]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)950gitlab # [ 7.377104] systemd[1]: Started User Login Management.951gitlab # [ 7.378325] systemd[1]: Starting linger-users.service...952gitlab # [ 7.385261] nsncd[676]: Sep 04 06:40:33.689 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"953gitlab # [ 7.387401] systemd[1]: Started Name Service Cache Daemon (nsncd).954gitlab # [ 7.388334] systemd[1]: Reached target Host and Network Name Lookups.955gitlab # [ 7.389398] systemd[1]: Reached target User and Group Name Lookups.956gitlab # [ 7.390358] systemd[1]: Finished resolvconf update.957gitlab # [ 7.391500] systemd[1]: Reached target Preparation for Network.958gitlab # [ 7.393970] systemd[1]: Starting DHCP Client...959gitlab # [ 7.394688] systemd[1]: Starting Address configuration of eth1...960gitlab # [ 7.397189] systemd[1]: Starting Extra networking commands....961gitlab # [ 7.398600] systemd[1]: linger-users.service: Deactivated successfully.962gitlab # [ 7.402531] systemd[1]: Finished linger-users.service.963gitlab # [ 7.421036] network-addresses-eth1-start[701]: adding address 192.168.1.1/24... done964gitlab # [ 7.424692] network-addresses-eth1-start[701]: adding address 2001:db8:1::1/64... done965gitlab # [ 7.434747] systemd[1]: Finished Address configuration of eth1.966gitlab # [ 7.456740] systemd[1]: Finished Extra networking commands..967gitlab # [ 7.457610] systemd[1]: Reached target Network.968gitlab # [ 7.459120] systemd[1]: Starting gitlab-workhorse.service...969gitlab # [ 7.460926] systemd[1]: Starting Nginx Web Server...970gitlab # [ 7.468278] systemd[1]: Starting PostgreSQL Server...971gitlab # [ 7.469338] dhcpcd[717]: dhcpcd-10.3.2 starting972gitlab # [ 7.470218] systemd[1]: Starting Redis Server - redis-gitlab...973gitlab # [ 7.472483] systemd[1]: Starting Permit User Sessions...974gitlab # [ 7.473775] dhcpcd[771]: dev: loaded udev975gitlab # [ 7.625245] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.625917] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.492732] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.978gitlab # [ 7.494689] systemd[1]: Finished Permit User Sessions.979gitlab # [ 7.499627] systemd[1]: Started Getty on tty1.980gitlab # [ 7.502096] systemd[1]: Reached target Login Prompts.981gitlab # [ 7.715450] cfg80211: Loading compiled-in X.509 certificates for regulatory database982gitlab # [ 7.720267] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'983gitlab # [ 7.721241] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'984gitlab # [ 7.722857] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2985gitlab # [ 7.723856] cfg80211: failed to load regulatory.db986gitlab # [ 7.589228] nginx-pre-start[792]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok987gitlab # [ 7.591035] nginx-pre-start[792]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful988gitlab # [ 7.594691] systemd[1]: Started Nginx Web Server.989gitlab # [ 7.756280] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # [ 7.611478] dhcpcd[771]: eth0: waiting for carrier991gitlab # [ 7.612291] dhcpcd[771]: eth0: carrier acquired992gitlab # [ 7.615597] dhcpcd[771]: DUID 00:01:00:01:32:2d:24:61:52:54:00:12:34:56993gitlab # [ 7.616266] dhcpcd[771]: eth0: IAID 00:12:34:56994gitlab # [ 7.616798] dhcpcd[771]: eth0: adding address fe80::5054:ff:fe12:3456995gitlab # [ 7.622313] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.996gitlab # [ 7.623036] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo997gitlab # [ 7.623640] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started998gitlab # [ 7.624396] redis-server[790]: Configuration loaded999gitlab # [ 7.624821] redis[790]: monotonic clock: POSIX clock_gettime1000gitlab # [ 7.628060] redis[790]: Running mode=standalone, port=0.1001gitlab # [ 7.628757] systemd[1]: Started Redis Server - redis-gitlab.1002gitlab # [ 7.629521] redis[790]: Server initialized1003gitlab # [ 7.629990] redis[790]: Ready to accept connections unix1004gitlab # [ 7.630739] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1005gitlab # [ 7.633685] postgresql-pre-start[796]: The files belonging to this database system will be owned by user "postgres".1006gitlab # [ 7.634637] postgresql-pre-start[796]: This user must also own the server process.1007gitlab # [ 7.637457] postgresql-pre-start[796]: The database cluster will be initialized with locale "en_US.UTF-8".1008gitlab # [ 7.638177] postgresql-pre-start[796]: The default database encoding has accordingly been set to "UTF8".1009gitlab # [ 7.638907] postgresql-pre-start[796]: The default text search configuration will be set to "english".1010gitlab # [ 7.639812] postgresql-pre-start[796]: Data page checksums are enabled.1011gitlab # [ 7.640335] postgresql-pre-start[796]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1012gitlab # [ 7.644382] postgresql-pre-start[796]: creating subdirectories ... ok1013gitlab # [ 7.645057] postgresql-pre-start[796]: selecting dynamic shared memory implementation ... posix1014gitlab # [ 7.678603] postgresql-pre-start[796]: selecting default "max_connections" ... 1001015gitlab # [ 7.722437] postgresql-pre-start[796]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 7.967965] systemd[1]: Started gitlab-workhorse.service.1017gitlab # [ 8.121560] postgresql-pre-start[796]: selecting default time zone ... UTC1018gitlab # [ 8.123192] postgresql-pre-start[796]: creating configuration files ... ok1019gitlab # [ 8.156040] gitlab-workhorse[826]: time="2026-09-04T06:40:34Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41020gitlab # [ 8.157725] gitlab-workhorse[826]: time="2026-09-04T06:40:34Z" level=info msg="Using redis/go-redis"1021gitlab # [ 8.159101] gitlab-workhorse[826]: time="2026-09-04T06:40:34Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1022gitlab # [ 8.281077] postgresql-pre-start[796]: running bootstrap script ... ok1023gitlab # [ 8.715734] postgresql-pre-start[796]: performing post-bootstrap initialization ... ok1024gitlab # [ 9.024652] postgresql-pre-start[796]: syncing data to disk ... ok1025gitlab # [ 9.025910] postgresql-pre-start[796]: initdb: warning: enabling "trust" authentication for local connections1026gitlab # [ 9.026788] postgresql-pre-start[796]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1027gitlab # [ 9.027644] postgresql-pre-start[796]: Success. You can now start the database server using:1028gitlab # [ 9.028619] postgresql-pre-start[796]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1029gitlab # [ 9.153485] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1030gitlab # [ 9.157732] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 54321031gitlab # [ 9.159218] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 54321032gitlab # [ 9.165079] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1033gitlab # [ 9.183228] postgres[861]: [861] LOG: database system was shut down at 2026-09-04 06:40:35 GMT1034gitlab # [ 9.192181] postgres[852]: [852] LOG: database system is ready to accept connections1035gitlab # [ 9.197393] systemd[1]: Started PostgreSQL Server.1036gitlab # [ 9.199515] systemd[1]: Starting PostgreSQL Setup Scripts...1037gitlab # [ 9.354397] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[869]: mkdir -p /var/gitlab/state/home/.ssh: OK1038gitlab # [ 9.357548] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[869]: chmod 700 /var/gitlab/state/home/.ssh: OK1039gitlab # [ 9.403761] systemd[1]: Finished gitlab-config.service.1040gitlab # [ 9.406459] systemd[1]: Started gitaly.service.1041gitlab # [ 9.411442] dhcpcd[771]: eth0: soliciting an IPv6 router1042gitlab # [ 9.412498] dhcpcd[771]: eth0: Router Advertisement from fe80::21043gitlab # [ 9.413308] dhcpcd[771]: eth0: adding address fec0::5054:ff:fe12:3456/641044gitlab # [ 9.414186] dhcpcd[771]: eth0: adding route to fec0::/641045gitlab # [ 9.415096] dhcpcd[771]: eth0: adding default route via fe80::21046gitlab # [ 9.416228] postgresql-setup-start[877]: CREATE DATABASE1047gitlab # [ 9.435112] postgresql-setup-start[905]: CREATE ROLE1048gitlab # [ 9.445878] postgresql-setup-start[907]: ALTER DATABASE1049gitlab # [ 9.466743] postgresql-setup-start[912]: CREATE ROLE1050gitlab # [ 9.468917] systemd[1]: Finished PostgreSQL Setup Scripts.1051gitlab # [ 9.470132] systemd[1]: Reached target PostgreSQL.1052gitlab # [ 9.472659] systemd[1]: Starting gitlab-db-config.service...1053gitlab # [ 9.474249] systemd[1]: Starting gitlab-postgresql.service...1054gitlab # [ 9.564345] gitlab-postgresql-start[922]: CREATE DATABASE1055gitlab # [ 9.595574] gitlab-postgresql-start[932]: CREATE EXTENSION1056gitlab # [ 9.601226] dhcpcd[771]: eth0: soliciting a DHCP lease1057gitlab # [ 9.752944] NET: Registered PF_PACKET protocol family1058gitlab # [ 9.611085] dhcpcd[771]: eth0: offered 10.0.2.15 from 10.0.2.21059gitlab # [ 9.615171] dhcpcd[771]: eth0: probing address 10.0.2.15/241060gitlab # [ 9.673346] gitlab-postgresql-start[934]: CREATE EXTENSION1061gitlab # [ 9.676085] systemd[1]: Finished gitlab-postgresql.service.1062gitlab # [ 9.873686] gitaly[900]: time="2026-09-04T06:40:36.177Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9001063gitlab # [ 9.874138] gitaly[900]: time="2026-09-04T06:40:36.177Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9001064gitlab # [ 9.874582] gitaly[900]: time="2026-09-04T06:40:36.177Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9001065gitlab # [ 9.875161] gitaly[900]: time="2026-09-04T06:40:36.177Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9001066gitlab # [ 9.875603] gitaly[900]: time="2026-09-04T06:40:36.178Z" level=info msg="Starting Gitaly" pid=900 version=1067gitlab # [ 10.047264] gitaly[900]: time="2026-09-04T06:40:36.351Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=163 pid=9001068gitlab # [ 10.049046] gitaly[900]: time="2026-09-04T06:40:36.352Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9001069gitlab # [ 10.050550] gitaly[900]: time="2026-09-04T06:40:36.353Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9001070gitlab # [ 10.051191] gitaly[900]: time="2026-09-04T06:40:36.353Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-900/git-exec-2661702392.d/git pid=9001071gitlab # [ 10.053899] gitaly[900]: time="2026-09-04T06:40:36.358Z" level=info msg="finished detecting git version" duration_ms=5 pid=9001072gitlab # [ 10.054497] gitaly[900]: time="2026-09-04T06:40:36.358Z" level=info msg="using Git version" pid=900 version=2.53.g1073gitlab # [ 10.056710] gitaly[900]: time="2026-09-04T06:40:36.361Z" level=info msg="clearing disk cache object folder" pid=900 storage=default1074gitlab # [ 10.057850] gitaly[900]: time="2026-09-04T06:40:36.361Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2727897852 pid=900 storage=default1075gitlab # [ 10.058676] gitaly[900]: time="2026-09-04T06:40:36.361Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2727897852 pid=900 storage=default1076gitlab # [ 10.059366] gitaly[900]: time="2026-09-04T06:40:36.361Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9001077gitlab # [ 10.059880] gitaly[900]: time="2026-09-04T06:40:36.361Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9001078gitlab # [ 10.060496] gitaly[900]: time="2026-09-04T06:40:36.362Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2727897852 clear_duration_ms=0 pid=900 storage=default1079gitlab # [ 10.105340] gitaly[900]: time="2026-09-04T06:40:36.409Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9001080gitlab # [ 10.106035] gitaly[900]: time="2026-09-04T06:40:36.409Z" level=info msg="counting repositories" pid=9001081gitlab # [ 10.106456] gitaly[900]: time="2026-09-04T06:40:36.409Z" level=info msg="finished tempdir cleaner walk" pid=900 storage=default time_ms=01082gitlab # [ 10.106921] gitaly[900]: time="2026-09-04T06:40:36.409Z" level=info msg="starting to count repositories" pid=900 storage_path=/var/gitlab/state/repositories1083gitlab # [ 10.107517] gitaly[900]: time="2026-09-04T06:40:36.409Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=900 schema=unix1084gitlab # [ 10.108056] gitaly[900]: time="2026-09-04T06:40:36.409Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=900 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.108485] gitaly[900]: time="2026-09-04T06:40:36.409Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9001086gitlab # [ 10.109039] gitaly[900]: time="2026-09-04T06:40:36.409Z" level=info msg="listening at address" address=/run/gitaly/gitaly-900/sock.d/intern pid=900 schema=unix1087gitlab # [ 10.109538] gitaly[900]: time="2026-09-04T06:40:36.410Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9001088gitlab # [ 10.109993] gitaly[900]: time="2026-09-04T06:40:36.410Z" level=info msg="Started Gitaly" duration_ms=232 pid=9001089gitlab # [ 10.110471] gitaly[900]: time="2026-09-04T06:40:36.410Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9001090gitlab # [ 10.110968] gitaly[900]: time="2026-09-04T06:40:36.411Z" level=info msg="maintenance: daily scheduled" pid=900 scheduled="2026-09-04 12:00:00 +0000 UTC"1091gitlab # [ 10.979499] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 10.983658] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 11.012850] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 12.048133] gitaly[900]: time="2026-09-04T06:40:38.351Z" level=info msg="License database preloaded" duration_ms=2173 pid=9001095gitlab # [ 14.732477] dhcpcd[771]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 14.734664] dhcpcd[771]: eth0: adding route to 10.0.2.0/241097gitlab # [ 14.736277] dhcpcd[771]: eth0: adding default route via 10.0.2.21098gitlab # [ 14.855285] systemd[1]: Started DHCP Client.1099gitlab # [ 14.858553] systemd[1]: Reached target Network is Online.1100gitlab # [ 40.272980] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[917]: W, [2026-09-04T06:41:06.576577 #917] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1101gitlab # [ 42.150796] postgres[1309]: [1309] ERROR: relation "feature_gates" does not exist at character 5231102gitlab # [ 42.152379] postgres[1309]: [1309] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1103gitlab # [ 42.153738] postgres[1309]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1104gitlab # [ 42.155966] postgres[1309]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1105gitlab # [ 42.158069] postgres[1309]: attidentity AS identity,1106gitlab # [ 42.159960] postgres[1309]: attgenerated as attgenerated1107gitlab # [ 42.161866] postgres[1309]: FROM pg_attribute a1108gitlab # [ 42.163095] postgres[1309]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1109gitlab # [ 42.164952] postgres[1309]: LEFT JOIN pg_type t ON a.atttypid = t.oid1110gitlab # [ 42.167269] postgres[1309]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1111gitlab # [ 42.168074] postgres[1309]: WHERE a.attrelid = '"feature_gates"'::regclass1112gitlab # [ 42.169991] postgres[1309]: AND a.attnum > 0 AND NOT a.attisdropped1113gitlab # [ 42.171872] postgres[1309]: ORDER BY a.attnum1114gitlab # [ 42.173129] postgres[1309]:1115gitlab # [ 45.428602] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1342]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 45.429727] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1342]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 48.209800] gitlab-workhorse[826]: time="2026-09-04T06:41:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 58.218399] gitlab-workhorse[826]: time="2026-09-04T06:41:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 60.997762] postgres[1408]: [1408] ERROR: relation "table_without_models" does not exist1120gitlab # [ 61.000584] postgres[1408]: [1408] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 68.227850] gitlab-workhorse[826]: time="2026-09-04T06:41:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 73.043940] systemd[1]: Finished gitlab-db-config.service.1123gitlab # [ 73.047555] systemd[1]: Started gitlab-sidekiq.service.1124gitlab # [ 73.050432] systemd[1]: Starting gitlab.service...1125gitlab # [ 73.408117] bundle[1584]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1126gitlab # [ 73.409717] bundle[1584]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1127gitlab # [ 73.411171] bundle[1584]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1128gitlab # [ 76.059343] sidekiq-cluster[1583]: {"severity":"INFO","time":"2026-09-04T06:41:42.346Z","message":"Starting cluster with 1 processes"}1129gitlab # [ 76.178587] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.463Z","pid":1584,"message":"* Enabling systemd notification integration"}1130gitlab # [ 76.179592] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"Puma starting in cluster mode..."}1131gitlab # [ 76.180454] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1132gitlab # [ 76.181227] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1133gitlab # [ 76.181979] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"* Min threads: 0"}1134gitlab # [ 76.182678] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"* Max threads: 4"}1135gitlab # [ 76.183576] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"* Environment: production"}1136gitlab # [ 76.184497] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"* Master PID: 1584"}1137gitlab # [ 76.185181] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"* Workers: 2"}1138gitlab # [ 76.185816] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1139gitlab # [ 76.186630] bundle[1584]: {"timestamp":"2026-09-04T06:41:42.482Z","pid":1584,"message":"* Preloading application"}1140gitlab # [ 78.232980] gitlab-workhorse[826]: time="2026-09-04T06:41:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 88.242744] gitlab-workhorse[826]: time="2026-09-04T06:41:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 98.252635] gitlab-workhorse[826]: time="2026-09-04T06:42:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 98.438291] bundle[1584]: W, [2026-09-04T06:42:04.741824 #1584] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 100.717519] sidekiq-cluster[1614]: 2026-09-04T06:42:07.020Z pid=1614 tid=wkm INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1614, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434216960}1145gitlab # [ 100.887664] sidekiq-cluster[1614]: W, [2026-09-04T06:42:07.191640 #1614] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 100.925373] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:07.229Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1147gitlab # [ 102.816615] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.120Z","message":"GitLab reliable fetch activated!"}1148gitlab # [ 102.817729] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.120Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1149gitlab # [ 102.858733] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.162Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1150gitlab # [ 102.862050] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.166Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1151gitlab # [ 102.865719] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.170Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1152gitlab # [ 102.868556] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.172Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1153gitlab # [ 102.870837] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.175Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1154gitlab # [ 102.873091] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.177Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1155gitlab # [ 102.875159] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.179Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1156gitlab # [ 102.877054] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.181Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1157gitlab # [ 102.879034] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.182Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1158gitlab # [ 102.881505] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.184Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1159gitlab # [ 102.884548] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.188Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1160gitlab # [ 102.888727] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.192Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1161gitlab # [ 102.893329] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.197Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1162gitlab # [ 102.897252] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.201Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1163gitlab # [ 102.901168] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.205Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1164gitlab # [ 102.905747] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.210Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1165gitlab # [ 102.913589] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.217Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1166gitlab # [ 102.919673] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.223Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1167gitlab # [ 102.925970] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.230Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1168gitlab # [ 102.932056] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.236Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1169gitlab # [ 102.938545] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.242Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1170gitlab # [ 102.944709] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.248Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1171gitlab # [ 102.952165] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.256Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1172gitlab # [ 102.958200] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.262Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1173gitlab # [ 102.963866] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.268Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1174gitlab # [ 102.970321] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.274Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1175gitlab # [ 102.976478] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.280Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1176gitlab # [ 102.982903] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.287Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1177gitlab # [ 102.988911] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.293Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1178gitlab # [ 102.994532] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.298Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1179gitlab # [ 102.999443] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.303Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1180gitlab # [ 103.005242] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.309Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1181gitlab # [ 103.010537] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.314Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1182gitlab # [ 103.016585] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.320Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1183gitlab # [ 103.021451] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.325Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1184gitlab # [ 103.026294] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.330Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1185gitlab # [ 103.031109] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.335Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1186gitlab # [ 103.036267] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.340Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1187gitlab # [ 103.041314] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.345Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1188gitlab # [ 103.045948] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.350Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1189gitlab # [ 103.051067] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.355Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1190gitlab # [ 103.055778] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.360Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1191gitlab # [ 103.060845] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.365Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1192gitlab # [ 103.065921] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.370Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1193gitlab # [ 103.071953] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.376Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1194gitlab # [ 103.077587] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.381Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1195gitlab # [ 103.082497] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.386Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1196gitlab # [ 103.087964] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.392Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1197gitlab # [ 103.093671] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.397Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1198gitlab # [ 103.098856] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.403Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1199gitlab # [ 103.104406] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.408Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1200gitlab # [ 103.112541] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.416Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1201gitlab # [ 103.133400] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.437Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1202gitlab # [ 103.140376] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.444Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1203gitlab # [ 103.146349] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.450Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1204gitlab # [ 103.152978] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.457Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1205gitlab # [ 103.158813] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.463Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1206gitlab # [ 103.165639] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.469Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1207gitlab # [ 103.171114] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.475Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1208gitlab # [ 103.177381] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.481Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1209gitlab # [ 103.183103] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.487Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1210gitlab # [ 103.188316] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.492Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1211gitlab # [ 103.194773] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.498Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1212gitlab # [ 103.201367] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.505Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1213gitlab # [ 103.207453] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.511Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1214gitlab # [ 103.213927] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.518Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1215gitlab # [ 103.218774] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.522Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1216gitlab # [ 103.224069] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.528Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1217gitlab # [ 103.229110] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.533Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1218gitlab # [ 103.234553] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.538Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1219gitlab # [ 103.239716] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.543Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1220gitlab # [ 103.279105] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.582Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1221gitlab # [ 103.285841] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.590Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1222gitlab # [ 103.293137] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.597Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1223gitlab # [ 103.300413] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.604Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1224gitlab # [ 103.307324] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.611Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1225gitlab # [ 103.317070] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.621Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1226gitlab # [ 103.325190] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.629Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1227gitlab # [ 103.333179] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.637Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1228gitlab # [ 103.340355] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.644Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1229gitlab # [ 103.348775] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.652Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1230gitlab # [ 103.356735] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.660Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1231gitlab # [ 103.366647] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.670Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1232gitlab # [ 103.374223] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.678Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1233gitlab # [ 103.382859] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.687Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1234gitlab # [ 103.390408] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.694Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1235gitlab # [ 103.399734] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.703Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1236gitlab # [ 103.407480] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.711Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1237gitlab # [ 103.415979] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.720Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1238gitlab # [ 103.423723] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.727Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1239gitlab # [ 103.431853] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.736Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1240gitlab # [ 103.440068] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.744Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1241gitlab # [ 103.447704] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.751Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1242gitlab # [ 103.456428] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.760Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1243gitlab # [ 103.464331] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.768Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1244gitlab # [ 103.474081] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.778Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1245gitlab # [ 103.481679] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.785Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1246gitlab # [ 103.489724] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.793Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1247gitlab # [ 103.515881] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.820Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1248gitlab # [ 103.524326] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.828Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1249gitlab # [ 103.532782] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.836Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1250gitlab # [ 103.542627] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.846Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1251gitlab # [ 103.552732] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.856Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1252gitlab # [ 103.563608] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.867Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1253gitlab # [ 103.574642] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.878Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1254gitlab # [ 103.584071] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.888Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1255gitlab # [ 103.593545] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.897Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1256gitlab # [ 103.604440] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.908Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1257gitlab # [ 103.614114] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:09.918Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1258gitlab # [ 108.262618] gitlab-workhorse[826]: time="2026-09-04T06:42:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1259gitlab # [ 118.263723] gitlab-workhorse[826]: time="2026-09-04T06:42:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 127.676780] postgres[2052]: [2052] ERROR: relation "table_without_models" does not exist1261gitlab # [ 127.678091] postgres[2052]: [2052] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1262gitlab # [ 128.265563] gitlab-workhorse[826]: time="2026-09-04T06:42:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 128.949768] postgres[2063]: [2063] ERROR: relation "table_without_models" does not exist1264gitlab # [ 128.951358] postgres[2063]: [2063] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 130.309248] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:36.613Z","message":"Booted Rails 7.2.3.1 application in production environment"}1266gitlab # [ 130.312057] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:36.615Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1267gitlab # [ 130.313311] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:36.615Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1268gitlab # [ 130.314967] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:36.617Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1269gitlab # [ 130.326272] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:36.630Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1270gitlab # [ 131.613003] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:37.916Z","message":"Cleaning working queues"}1271gitlab # [ 131.618783] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:37.922Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3d3141a5b0a962bd359309ee","created_at":"2026-09-04T06:41:39.063Z","trace_propagation_headers":{"sentry-trace":"4bfc486691d34dcfb2f369fa93ade556-16debbc7831948b1","baggage":"sentry-trace_id=4bfc486691d34dcfb2f369fa93ade556,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cef1d3a3e2d0bdf79ab3a9f732b169de","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T06:41:39.071Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3d3141a5b0a962bd359309ee: start","job_status":"start","queue_duration_s":58.85068,"scheduling_latency_s":58.850741}1272gitlab # [ 131.719085] bundle[1584]: {"timestamp":"2026-09-04T06:42:38.022Z","pid":1584,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1273gitlab # [ 131.722500] bundle[1584]: {"timestamp":"2026-09-04T06:42:38.022Z","pid":1584,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1274gitlab # [ 131.725591] bundle[1584]: {"timestamp":"2026-09-04T06:42:38.022Z","pid":1584,"message":"! #\u003cThread:0x00007e31d5944a28 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1275gitlab # [ 131.734337] bundle[1584]: {"timestamp":"2026-09-04T06:42:38.022Z","pid":1584,"message":"! #\u003cThread:0x00007e31d5be9170 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1276gitlab # [ 131.739423] bundle[1584]: {"timestamp":"2026-09-04T06:42:38.023Z","pid":1584,"message":"Use Ctrl-C to stop"}1277gitlab # [ 131.740685] bundle[1584]: {"timestamp":"2026-09-04T06:42:38.023Z","pid":1584,"message":"Sending status to systemd every 1.0 sec"}1278gitlab # [ 131.775321] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:42:38.079Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3d3141a5b0a962bd359309ee","created_at":"2026-09-04T06:41:39.063Z","trace_propagation_headers":{"sentry-trace":"4bfc486691d34dcfb2f369fa93ade556-16debbc7831948b1","baggage":"sentry-trace_id=4bfc486691d34dcfb2f369fa93ade556,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cef1d3a3e2d0bdf79ab3a9f732b169de","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T06:41:39.071Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3d3141a5b0a962bd359309ee: done: 0.156934 sec","job_status":"done","queue_duration_s":58.85068,"scheduling_latency_s":58.850741,"redis_calls":26,"redis_duration_s":0.004744,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.0028,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07160714600000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.156934,"completed_at":"2026-09-04T06:42:38.079Z","load_balancing_strategy":"primary","db_duration_s":0.032349,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1279gitlab # [ 132.003541] bundle[1584]: {"timestamp":"2026-09-04T06:42:38.307Z","pid":1584,"message":"- Worker 0 (PID: 2164) booted in 0.26s, phase: 0"}1280gitlab # [ 132.027488] bundle[1584]: {"timestamp":"2026-09-04T06:42:38.331Z","pid":1584,"message":"- Worker 1 (PID: 2168) booted in 0.26s, phase: 0"}1281gitlab # [ 132.033871] systemd[1]: Started gitlab.service.1282gitlab # [ 132.035716] systemd[1]: Reached target Common target for all GitLab services..1283gitlab # [ 132.040962] systemd[1]: Starting setup-gitlab.service...1284gitlab # [ 132.068627] setup-gitlab-start[2192]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1285gitlab # [ 134.357436] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:42:40 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 22601286gitlab # [ 134.360307] setup-gitlab-start[2192]: + TOKEN=nixbot-test-token-of-20-chars1287gitlab # [ 134.361077] setup-gitlab-start[2192]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1288gitlab # [ 134.378928] runuser[2214]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1289gitlab # [ 134.767042] setup-gitlab-start[2215]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1290gitlab # [ 134.767824] setup-gitlab-start[2215]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1291gitlab # [ 134.768899] setup-gitlab-start[2215]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1292gitlab # [ 135.351471] setup-gitlab-start[2215]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 135.353931] setup-gitlab-start[2215]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 135.355608] setup-gitlab-start[2215]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 158.613242] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:04.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"abf611a0295691a763d9db84","created_at":"2026-09-04T06:43:04.887Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74f8fb07e28bdbdc68bae6363d57adf8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T06:43:04.913Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-abf611a0295691a763d9db84: start","job_status":"start","queue_duration_s":0.002472,"scheduling_latency_s":0.002515}1296gitlab # [ 158.682138] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:04.984Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1297gitlab # [ 158.707764] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"abf611a0295691a763d9db84","created_at":"2026-09-04T06:43:04.887Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74f8fb07e28bdbdc68bae6363d57adf8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T06:43:04.913Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-abf611a0295691a763d9db84: done: 0.095188 sec","job_status":"done","queue_duration_s":0.002472,"scheduling_latency_s":0.002515,"redis_calls":10,"redis_duration_s":0.023686,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001769,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.008502,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000949842,"duration_s":0.095188,"completed_at":"2026-09-04T06:43:05.011Z","load_balancing_strategy":"primary","db_duration_s":0.002098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 158.713738] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b3c6ccc69879673fa40f4e2a","created_at":"2026-09-04T06:43:04.947Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"327f35b47eb029265323934d6e7721bb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:04.969Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b3c6ccc69879673fa40f4e2a: start","job_status":"start","queue_duration_s":0.047487,"scheduling_latency_s":0.047536}1299gitlab # [ 158.750683] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b3c6ccc69879673fa40f4e2a","created_at":"2026-09-04T06:43:04.947Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"327f35b47eb029265323934d6e7721bb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:04.969Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b3c6ccc69879673fa40f4e2a: done: 0.037321 sec","job_status":"done","queue_duration_s":0.047487,"scheduling_latency_s":0.047536,"redis_calls":10,"redis_duration_s":0.0033,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000704,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001945,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000586667,"duration_s":0.037321,"completed_at":"2026-09-04T06:43:05.054Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 158.823842] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1d135923350e0aa94e2fffcc","created_at":"2026-09-04T06:43:04.983Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"242cb6eadc213ce2b2e3da91f8896154","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.125Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1d135923350e0aa94e2fffcc: start","job_status":"start","queue_duration_s":0.001861,"scheduling_latency_s":0.001907}1301gitlab # [ 158.938723] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1d135923350e0aa94e2fffcc","created_at":"2026-09-04T06:43:04.983Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"242cb6eadc213ce2b2e3da91f8896154","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.125Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1d135923350e0aa94e2fffcc: done: 0.114547 sec","job_status":"done","queue_duration_s":0.001861,"scheduling_latency_s":0.001907,"redis_calls":13,"redis_duration_s":0.029577,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002962,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.022657,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003958,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.026846428999999998,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.114547,"completed_at":"2026-09-04T06:43:05.242Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026758,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1302gitlab # [ 158.999585] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.245Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"7f32f5a81f2c46168ccb9cad","created_at":"2026-09-04T06:43:05.148Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"773a0a40d5a12acb61276984eb984626","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.158Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-7f32f5a81f2c46168ccb9cad: start","job_status":"start","queue_duration_s":0.08715,"scheduling_latency_s":0.087188}1303gitlab # [ 159.036957] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"7f32f5a81f2c46168ccb9cad","created_at":"2026-09-04T06:43:05.148Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"773a0a40d5a12acb61276984eb984626","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.158Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-7f32f5a81f2c46168ccb9cad: done: 0.095337 sec","job_status":"done","queue_duration_s":0.08715,"scheduling_latency_s":0.087188,"redis_calls":12,"redis_duration_s":0.007767,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000945,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003531,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003291,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000828038,"exclusive_lock_hold_duration_s":0.039421212,"duration_s":0.095337,"completed_at":"2026-09-04T06:43:05.340Z","load_balancing_strategy":"primary","db_duration_s":0.063691,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 159.065845] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c23f33792cefc2665cfcae07","created_at":"2026-09-04T06:43:05.173Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac0e192d77480829282b80d2768a96a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.192Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c23f33792cefc2665cfcae07: start","job_status":"start","queue_duration_s":0.177288,"scheduling_latency_s":0.177312}1305gitlab # [ 159.383703] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.687Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c23f33792cefc2665cfcae07","created_at":"2026-09-04T06:43:05.173Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac0e192d77480829282b80d2768a96a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.192Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c23f33792cefc2665cfcae07: done: 0.317477 sec","job_status":"done","queue_duration_s":0.177288,"scheduling_latency_s":0.177312,"redis_calls":14,"redis_duration_s":0.012449,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.006352,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003849,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002248,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.065,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.063,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.15629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000582197,"exclusive_lock_hold_duration_s":0.282065179,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.317477,"completed_at":"2026-09-04T06:43:05.687Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.122417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 159.458627] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"52aac1a4a90dc5808cbb228c","created_at":"2026-09-04T06:43:05.200Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73572391237b32cab02a78bb778aa1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.212Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-52aac1a4a90dc5808cbb228c: start","job_status":"start","queue_duration_s":0.477021,"scheduling_latency_s":0.477037}1307gitlab # [ 159.641420] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"52aac1a4a90dc5808cbb228c","created_at":"2026-09-04T06:43:05.200Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73572391237b32cab02a78bb778aa1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.212Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-52aac1a4a90dc5808cbb228c: done: 0.255489 sec","job_status":"done","queue_duration_s":0.477021,"scheduling_latency_s":0.477037,"redis_calls":565,"redis_duration_s":0.100984,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.099261,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000299759,"duration_s":0.255489,"completed_at":"2026-09-04T06:43:05.944Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000498,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 159.717270] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a67c9eebd7392d7c960a43bc","created_at":"2026-09-04T06:43:05.238Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4eeabefb48c1386f712fb740777eafdc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.260Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a67c9eebd7392d7c960a43bc: start","job_status":"start","queue_duration_s":0.685268,"scheduling_latency_s":0.685284}1309gitlab # [ 159.730232] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.954Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1310gitlab # [ 159.733317] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a67c9eebd7392d7c960a43bc","created_at":"2026-09-04T06:43:05.238Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4eeabefb48c1386f712fb740777eafdc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.260Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a67c9eebd7392d7c960a43bc: done: 0.013502 sec","job_status":"done","queue_duration_s":0.685268,"scheduling_latency_s":0.685284,"redis_calls":10,"redis_duration_s":0.002341,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000502,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000333841,"duration_s":0.013502,"completed_at":"2026-09-04T06:43:05.959Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 159.770641] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:05.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0a33fb61c0ada4082a89b7da","created_at":"2026-09-04T06:43:05.271Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.277Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0a33fb61c0ada4082a89b7da: start","job_status":"start","queue_duration_s":0.682727,"scheduling_latency_s":0.68274}1312gitlab # [ 159.783438] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0a33fb61c0ada4082a89b7da","created_at":"2026-09-04T06:43:05.271Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.277Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0a33fb61c0ada4082a89b7da: done: 0.105493 sec","job_status":"done","queue_duration_s":0.682727,"scheduling_latency_s":0.68274,"redis_calls":71,"redis_duration_s":0.015576,"redis_read_bytes":120,"redis_write_bytes":42574,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002194,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00094,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.011816,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047995,"duration_s":0.105493,"completed_at":"2026-09-04T06:43:06.066Z","load_balancing_strategy":"primary","db_duration_s":0.020078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 159.784879] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.068Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"dd28e6d572aa07ce3b11ec54","created_at":"2026-09-04T06:43:05.284Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d013132777a3503fe9e03dca7abd2674","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.297Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-dd28e6d572aa07ce3b11ec54: start","job_status":"start","queue_duration_s":0.771196,"scheduling_latency_s":0.771231}1314gitlab # [ 159.848606] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"dd28e6d572aa07ce3b11ec54","created_at":"2026-09-04T06:43:05.284Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d013132777a3503fe9e03dca7abd2674","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.297Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-dd28e6d572aa07ce3b11ec54: done: 0.083309 sec","job_status":"done","queue_duration_s":0.771196,"scheduling_latency_s":0.771231,"redis_calls":12,"redis_duration_s":0.0514,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.049284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000548952,"exclusive_lock_hold_duration_s":0.003208228,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.083309,"completed_at":"2026-09-04T06:43:06.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009512,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 159.889170] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"96e4e5288e0157df60852721","created_at":"2026-09-04T06:43:05.308Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caeced2342cafc4d7007d8065c734216","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.312Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-96e4e5288e0157df60852721: start","job_status":"start","queue_duration_s":0.880472,"scheduling_latency_s":0.880506}1316gitlab # [ 159.916575] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.220Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1317gitlab # [ 159.928973] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"96e4e5288e0157df60852721","created_at":"2026-09-04T06:43:05.308Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caeced2342cafc4d7007d8065c734216","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.312Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-96e4e5288e0157df60852721: done: 0.040251 sec","job_status":"done","queue_duration_s":0.880472,"scheduling_latency_s":0.880506,"redis_calls":10,"redis_duration_s":0.003083,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000672,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001997,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000614044,"duration_s":0.040251,"completed_at":"2026-09-04T06:43:06.232Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 159.931348] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.235Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"207a78a4b4bdb2c01c9bc04c","created_at":"2026-09-04T06:43:05.325Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05f1c21fa697e0a2692669c4a2b963f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.335Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-207a78a4b4bdb2c01c9bc04c: start","job_status":"start","queue_duration_s":0.899652,"scheduling_latency_s":0.899687}1319gitlab # [ 159.945993] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.250Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1320gitlab # [ 159.951262] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"207a78a4b4bdb2c01c9bc04c","created_at":"2026-09-04T06:43:05.325Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05f1c21fa697e0a2692669c4a2b963f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.335Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-207a78a4b4bdb2c01c9bc04c: done: 0.020067 sec","job_status":"done","queue_duration_s":0.899652,"scheduling_latency_s":0.899687,"redis_calls":10,"redis_duration_s":0.002363,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000466,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001495,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000402,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223492,"duration_s":0.020067,"completed_at":"2026-09-04T06:43:06.255Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 160.009974] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"36bf3d8e8b28416d30e83320","created_at":"2026-09-04T06:43:05.368Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c0db437d2e05435352d6c4cdb8bdbcf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.380Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-36bf3d8e8b28416d30e83320: start","job_status":"start","queue_duration_s":0.875949,"scheduling_latency_s":0.875965}1322gitlab # [ 160.010630] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"36bf3d8e8b28416d30e83320","created_at":"2026-09-04T06:43:05.368Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c0db437d2e05435352d6c4cdb8bdbcf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.380Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-36bf3d8e8b28416d30e83320: done: 0.026732 sec","job_status":"done","queue_duration_s":0.875949,"scheduling_latency_s":0.875965,"redis_calls":12,"redis_duration_s":0.002022,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000729,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000799823,"exclusive_lock_hold_duration_s":0.010340699,"duration_s":0.026732,"completed_at":"2026-09-04T06:43:06.283Z","load_balancing_strategy":"primary","db_duration_s":0.004195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 160.029660] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.284Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3bc3ffbac89be06670d865f3","created_at":"2026-09-04T06:43:05.392Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec2f17b7d771652fbe709e1b32341702","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T06:43:05.408Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3bc3ffbac89be06670d865f3: start","job_status":"start","queue_duration_s":0.875588,"scheduling_latency_s":0.875603}1324gitlab # [ 160.069782] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.292Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1325gitlab # [ 160.070555] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.297Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3bc3ffbac89be06670d865f3","created_at":"2026-09-04T06:43:05.392Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec2f17b7d771652fbe709e1b32341702","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T06:43:05.408Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3bc3ffbac89be06670d865f3: done: 0.013169 sec","job_status":"done","queue_duration_s":0.875588,"scheduling_latency_s":0.875603,"redis_calls":10,"redis_duration_s":0.001702,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000577,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200863,"duration_s":0.013169,"completed_at":"2026-09-04T06:43:06.297Z","load_balancing_strategy":"primary","db_duration_s":0.000287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 160.080700] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.298Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8dda4af21e21d1e1f2474f99","created_at":"2026-09-04T06:43:05.423Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93befb984dce3b515f35a99606911829","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.430Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8dda4af21e21d1e1f2474f99: start","job_status":"start","queue_duration_s":0.867582,"scheduling_latency_s":0.867598}1327gitlab # [ 160.129588] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8dda4af21e21d1e1f2474f99","created_at":"2026-09-04T06:43:05.423Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93befb984dce3b515f35a99606911829","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.430Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8dda4af21e21d1e1f2474f99: done: 0.013106 sec","job_status":"done","queue_duration_s":0.867582,"scheduling_latency_s":0.867598,"redis_calls":12,"redis_duration_s":0.001439,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000188292,"duration_s":0.013106,"completed_at":"2026-09-04T06:43:06.311Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 160.130956] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"acd8bfbc8604d1bf8dddd184","created_at":"2026-09-04T06:43:05.434Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4aca46665cad9b86466cabb946d59706","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T06:43:05.440Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-acd8bfbc8604d1bf8dddd184: start","job_status":"start","queue_duration_s":0.871269,"scheduling_latency_s":0.871282}1329gitlab # [ 160.142655] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"acd8bfbc8604d1bf8dddd184","created_at":"2026-09-04T06:43:05.434Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4aca46665cad9b86466cabb946d59706","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T06:43:05.440Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-acd8bfbc8604d1bf8dddd184: done: 0.023714 sec","job_status":"done","queue_duration_s":0.871269,"scheduling_latency_s":0.871282,"redis_calls":10,"redis_duration_s":0.0012460000000000001,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213155,"duration_s":0.023714,"completed_at":"2026-09-04T06:43:06.335Z","load_balancing_strategy":"primary","db_duration_s":0.006977,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 160.203579] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9b89b987695eed08919362b9","created_at":"2026-09-04T06:43:05.448Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39866d2ba1280b277e98d50f9752ecb2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9b89b987695eed08919362b9: start","job_status":"start","queue_duration_s":0.880353,"scheduling_latency_s":0.880367}1331gitlab # [ 160.204311] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9b89b987695eed08919362b9","created_at":"2026-09-04T06:43:05.448Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39866d2ba1280b277e98d50f9752ecb2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9b89b987695eed08919362b9: done: 0.022176 sec","job_status":"done","queue_duration_s":0.880353,"scheduling_latency_s":0.880367,"redis_calls":12,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000288305,"exclusive_lock_hold_duration_s":0.0103407,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.022176,"completed_at":"2026-09-04T06:43:06.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 160.231422] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"25e7c3c70447051c7952bb1f","created_at":"2026-09-04T06:43:05.464Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abe73f4a4a7250d0a9025a631b030615","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.474Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-25e7c3c70447051c7952bb1f: start","job_status":"start","queue_duration_s":0.886061,"scheduling_latency_s":0.886075}1333gitlab # [ 160.276848] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"25e7c3c70447051c7952bb1f","created_at":"2026-09-04T06:43:05.464Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abe73f4a4a7250d0a9025a631b030615","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.474Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-25e7c3c70447051c7952bb1f: done: 0.02104 sec","job_status":"done","queue_duration_s":0.886061,"scheduling_latency_s":0.886075,"redis_calls":10,"redis_duration_s":0.001458,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000252546,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.02104,"completed_at":"2026-09-04T06:43:06.381Z","load_balancing_strategy":"primary","db_duration_s":0.005821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 160.280849] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"97398da45c0def722eb26be3","created_at":"2026-09-04T06:43:05.488Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e87272f321ae84fe2c36e34d1d778b53","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.495Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-97398da45c0def722eb26be3: start","job_status":"start","queue_duration_s":0.886802,"scheduling_latency_s":0.886818}1335gitlab # [ 160.293942] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"97398da45c0def722eb26be3","created_at":"2026-09-04T06:43:05.488Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e87272f321ae84fe2c36e34d1d778b53","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.495Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-97398da45c0def722eb26be3: done: 0.027726 sec","job_status":"done","queue_duration_s":0.886802,"scheduling_latency_s":0.886818,"redis_calls":12,"redis_duration_s":0.001582,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000371555,"exclusive_lock_hold_duration_s":0.008325359,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.027726,"completed_at":"2026-09-04T06:43:06.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 160.342103] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.411Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"cda87e99678ffa302c67ace8","created_at":"2026-09-04T06:43:05.515Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c95d65f9971d0682c06f6f401b0369d4","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.524Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-cda87e99678ffa302c67ace8: start","job_status":"start","queue_duration_s":0.886119,"scheduling_latency_s":0.886135}1337gitlab # [ 160.380267] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"cda87e99678ffa302c67ace8","created_at":"2026-09-04T06:43:05.515Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c95d65f9971d0682c06f6f401b0369d4","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.524Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-cda87e99678ffa302c67ace8: done: 0.018997 sec","job_status":"done","queue_duration_s":0.886119,"scheduling_latency_s":0.886135,"redis_calls":16,"redis_duration_s":0.002018,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001042,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000354794,"duration_s":0.018997,"completed_at":"2026-09-04T06:43:06.429Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002415,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 160.381707] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.431Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"846dd032b087a0c574dec6bd","created_at":"2026-09-04T06:43:05.538Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.546Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-846dd032b087a0c574dec6bd: start","job_status":"start","queue_duration_s":0.885039,"scheduling_latency_s":0.885053}1339gitlab # [ 160.393595] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"846dd032b087a0c574dec6bd","created_at":"2026-09-04T06:43:05.538Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.546Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-846dd032b087a0c574dec6bd: done: 0.033458 sec","job_status":"done","queue_duration_s":0.885039,"scheduling_latency_s":0.885053,"redis_calls":19,"redis_duration_s":0.011286,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002162,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000944,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006712,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000989512,"duration_s":0.033458,"completed_at":"2026-09-04T06:43:06.464Z","load_balancing_strategy":"primary","db_duration_s":0.004656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 160.449727] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fb16f018b9bed9b6788d2399","created_at":"2026-09-04T06:43:05.559Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a65d024a710ea08de65ae148f5647763","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.567Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fb16f018b9bed9b6788d2399: start","job_status":"start","queue_duration_s":0.89966,"scheduling_latency_s":0.899675}1341gitlab # [ 160.450566] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.480Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fb16f018b9bed9b6788d2399","created_at":"2026-09-04T06:43:05.559Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a65d024a710ea08de65ae148f5647763","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.567Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fb16f018b9bed9b6788d2399: done: 0.01264 sec","job_status":"done","queue_duration_s":0.89966,"scheduling_latency_s":0.899675,"redis_calls":10,"redis_duration_s":0.001246,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195276,"duration_s":0.01264,"completed_at":"2026-09-04T06:43:06.480Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 160.481971] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"db8714bc000d63cb7f62f5d8","created_at":"2026-09-04T06:43:05.585Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1710ee7fbb80b17983a58654f34b394f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.593Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-db8714bc000d63cb7f62f5d8: start","job_status":"start","queue_duration_s":0.887969,"scheduling_latency_s":0.887983}1343gitlab # [ 160.529561] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.487Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1344gitlab # [ 160.530595] setup-gitlab-start[2215]: W, [2026-09-04T06:43:06.725952 #2215] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1345gitlab # [ 160.531162] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"db8714bc000d63cb7f62f5d8","created_at":"2026-09-04T06:43:05.585Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-dd699a5cfb4d4ed9","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1710ee7fbb80b17983a58654f34b394f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:05.593Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-db8714bc000d63cb7f62f5d8: done: 0.011126 sec","job_status":"done","queue_duration_s":0.887969,"scheduling_latency_s":0.887983,"redis_calls":10,"redis_duration_s":0.001222,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192482,"duration_s":0.011126,"completed_at":"2026-09-04T06:43:06.492Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 160.536754] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"898569f897b894b5d9ba3853","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-898569f897b894b5d9ba3853: start","job_status":"start","queue_duration_s":0.440559,"scheduling_latency_s":0.440573}1347gitlab # [ 160.574671] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"898569f897b894b5d9ba3853","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-898569f897b894b5d9ba3853: done: 0.01364 sec","job_status":"done","queue_duration_s":0.440559,"scheduling_latency_s":0.440573,"redis_calls":16,"redis_duration_s":0.001916,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231034,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01364,"completed_at":"2026-09-04T06:43:06.507Z","load_balancing_strategy":"primary","db_duration_s":0.000226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 160.585078] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b28f702ac151ae8afebfb7d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b28f702ac151ae8afebfb7d: start","job_status":"start","queue_duration_s":0.459325,"scheduling_latency_s":0.459339}1349gitlab # [ 160.623175] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b28f702ac151ae8afebfb7d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b28f702ac151ae8afebfb7d: done: 0.018283 sec","job_status":"done","queue_duration_s":0.459325,"scheduling_latency_s":0.459339,"redis_calls":13,"redis_duration_s":0.009187,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018283,"completed_at":"2026-09-04T06:43:06.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 160.627773] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b64c433788e59d6c94c48fd","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b64c433788e59d6c94c48fd: start","job_status":"start","queue_duration_s":0.480341,"scheduling_latency_s":0.480356}1351gitlab # [ 160.638785] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b64c433788e59d6c94c48fd","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b64c433788e59d6c94c48fd: done: 0.01362 sec","job_status":"done","queue_duration_s":0.480341,"scheduling_latency_s":0.480356,"redis_calls":13,"redis_duration_s":0.004866,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003302,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01362,"completed_at":"2026-09-04T06:43:06.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 160.685856] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aedcb4918effd9014436e1a6","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aedcb4918effd9014436e1a6: start","job_status":"start","queue_duration_s":0.49491,"scheduling_latency_s":0.494925}1353gitlab # [ 160.686565] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aedcb4918effd9014436e1a6","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aedcb4918effd9014436e1a6: done: 0.009896 sec","job_status":"done","queue_duration_s":0.49491,"scheduling_latency_s":0.494925,"redis_calls":13,"redis_duration_s":0.001903,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001428,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009896,"completed_at":"2026-09-04T06:43:06.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 160.726606] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d30aa0d5c1969aee98312b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d30aa0d5c1969aee98312b: start","job_status":"start","queue_duration_s":0.50549,"scheduling_latency_s":0.505502}1355gitlab # [ 160.727631] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d30aa0d5c1969aee98312b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d30aa0d5c1969aee98312b: done: 0.009445 sec","job_status":"done","queue_duration_s":0.50549,"scheduling_latency_s":0.505502,"redis_calls":13,"redis_duration_s":0.0015869999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009445,"completed_at":"2026-09-04T06:43:06.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 160.765532] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87039e900b8ab5376590dc6d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87039e900b8ab5376590dc6d: start","job_status":"start","queue_duration_s":0.515754,"scheduling_latency_s":0.515767}1357gitlab # [ 160.772497] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87039e900b8ab5376590dc6d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87039e900b8ab5376590dc6d: done: 0.009488 sec","job_status":"done","queue_duration_s":0.515754,"scheduling_latency_s":0.515767,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009488,"completed_at":"2026-09-04T06:43:06.578Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 160.807116] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9994891eb7370102c814222","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9994891eb7370102c814222: start","job_status":"start","queue_duration_s":0.526024,"scheduling_latency_s":0.526038}1359gitlab # [ 160.846206] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9994891eb7370102c814222","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9994891eb7370102c814222: done: 0.021753 sec","job_status":"done","queue_duration_s":0.526024,"scheduling_latency_s":0.526038,"redis_calls":13,"redis_duration_s":0.009404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002722,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006682,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021753,"completed_at":"2026-09-04T06:43:06.601Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 160.852023] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0db6eaac766903b4f70ba88","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0db6eaac766903b4f70ba88: start","job_status":"start","queue_duration_s":0.550397,"scheduling_latency_s":0.550412}1361gitlab # [ 160.863110] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0db6eaac766903b4f70ba88","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0db6eaac766903b4f70ba88: done: 0.011209 sec","job_status":"done","queue_duration_s":0.550397,"scheduling_latency_s":0.550412,"redis_calls":13,"redis_duration_s":0.0025459999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011209,"completed_at":"2026-09-04T06:43:06.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 160.907615] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6062cd87e0abdbb6dbf3868a","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6062cd87e0abdbb6dbf3868a: start","job_status":"start","queue_duration_s":0.562398,"scheduling_latency_s":0.562412}1363gitlab # [ 160.908604] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6062cd87e0abdbb6dbf3868a","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6062cd87e0abdbb6dbf3868a: done: 0.009282 sec","job_status":"done","queue_duration_s":0.562398,"scheduling_latency_s":0.562412,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009282,"completed_at":"2026-09-04T06:43:06.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 160.971911] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26028ef7fd123140568576e9","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26028ef7fd123140568576e9: start","job_status":"start","queue_duration_s":0.572476,"scheduling_latency_s":0.57249}1365gitlab # [ 160.972630] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26028ef7fd123140568576e9","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26028ef7fd123140568576e9: done: 0.009073 sec","job_status":"done","queue_duration_s":0.572476,"scheduling_latency_s":0.57249,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009073,"completed_at":"2026-09-04T06:43:06.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 160.989048] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a3f525520f820cdd0ff634d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a3f525520f820cdd0ff634d: start","job_status":"start","queue_duration_s":0.582507,"scheduling_latency_s":0.58252}1367gitlab # [ 161.000443] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a3f525520f820cdd0ff634d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a3f525520f820cdd0ff634d: done: 0.010524 sec","job_status":"done","queue_duration_s":0.582507,"scheduling_latency_s":0.58252,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010524,"completed_at":"2026-09-04T06:43:06.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 161.043150] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0478da94fa6c5955c31c3cd7","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0478da94fa6c5955c31c3cd7: start","job_status":"start","queue_duration_s":0.594028,"scheduling_latency_s":0.594042}1369gitlab # [ 161.082631] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0478da94fa6c5955c31c3cd7","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0478da94fa6c5955c31c3cd7: done: 0.009183 sec","job_status":"done","queue_duration_s":0.594028,"scheduling_latency_s":0.594042,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009183,"completed_at":"2026-09-04T06:43:06.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 161.083680] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd5f2ab45ef9d20d3aaa31f6","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd5f2ab45ef9d20d3aaa31f6: start","job_status":"start","queue_duration_s":0.604191,"scheduling_latency_s":0.604204}1371gitlab # [ 161.091563] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd5f2ab45ef9d20d3aaa31f6","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd5f2ab45ef9d20d3aaa31f6: done: 0.009177 sec","job_status":"done","queue_duration_s":0.604191,"scheduling_latency_s":0.604204,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009177,"completed_at":"2026-09-04T06:43:06.666Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 161.126673] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e5423e1cb5c4304410e3a11","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e5423e1cb5c4304410e3a11: start","job_status":"start","queue_duration_s":0.614311,"scheduling_latency_s":0.614325}1373gitlab # [ 161.168577] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e5423e1cb5c4304410e3a11","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e5423e1cb5c4304410e3a11: done: 0.009065 sec","job_status":"done","queue_duration_s":0.614311,"scheduling_latency_s":0.614325,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009065,"completed_at":"2026-09-04T06:43:06.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 161.171775] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d0f603e0adb3326dd0517dd","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d0f603e0adb3326dd0517dd: start","job_status":"start","queue_duration_s":0.624307,"scheduling_latency_s":0.624321}1375gitlab # [ 161.182896] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d0f603e0adb3326dd0517dd","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d0f603e0adb3326dd0517dd: done: 0.009069 sec","job_status":"done","queue_duration_s":0.624307,"scheduling_latency_s":0.624321,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009069,"completed_at":"2026-09-04T06:43:06.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 161.248534] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a0332efd51eceac32b4add1","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a0332efd51eceac32b4add1: start","job_status":"start","queue_duration_s":0.634313,"scheduling_latency_s":0.634325}1377gitlab # [ 161.249407] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a0332efd51eceac32b4add1","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a0332efd51eceac32b4add1: done: 0.009346 sec","job_status":"done","queue_duration_s":0.634313,"scheduling_latency_s":0.634325,"redis_calls":13,"redis_duration_s":0.001741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001267,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009346,"completed_at":"2026-09-04T06:43:06.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 161.262827] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0d06a1e6259d334f0b148b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0d06a1e6259d334f0b148b: start","job_status":"start","queue_duration_s":0.644611,"scheduling_latency_s":0.644624}1379gitlab # [ 161.273883] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0d06a1e6259d334f0b148b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0d06a1e6259d334f0b148b: done: 0.009189 sec","job_status":"done","queue_duration_s":0.644611,"scheduling_latency_s":0.644624,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009189,"completed_at":"2026-09-04T06:43:06.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 161.328783] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5793a615fb8509e05d44ff95","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5793a615fb8509e05d44ff95: start","job_status":"start","queue_duration_s":0.654591,"scheduling_latency_s":0.654605}1381gitlab # [ 161.329686] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5793a615fb8509e05d44ff95","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5793a615fb8509e05d44ff95: done: 0.055166 sec","job_status":"done","queue_duration_s":0.654591,"scheduling_latency_s":0.654605,"redis_calls":13,"redis_duration_s":0.004013,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002415,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.055166,"completed_at":"2026-09-04T06:43:06.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 161.353687] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48bbe191795bfc48774971ed","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48bbe191795bfc48774971ed: start","job_status":"start","queue_duration_s":0.710736,"scheduling_latency_s":0.710754}1383gitlab # [ 161.364819] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48bbe191795bfc48774971ed","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48bbe191795bfc48774971ed: done: 0.033484 sec","job_status":"done","queue_duration_s":0.710736,"scheduling_latency_s":0.710754,"redis_calls":13,"redis_duration_s":0.003456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033484,"completed_at":"2026-09-04T06:43:06.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 161.409051] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49c4c57839c6536e346ab451","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49c4c57839c6536e346ab451: start","job_status":"start","queue_duration_s":0.748703,"scheduling_latency_s":0.74873}1385gitlab # [ 161.409729] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49c4c57839c6536e346ab451","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49c4c57839c6536e346ab451: done: 0.080368 sec","job_status":"done","queue_duration_s":0.748703,"scheduling_latency_s":0.74873,"redis_calls":13,"redis_duration_s":0.053538,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.012444,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.041094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.080368,"completed_at":"2026-09-04T06:43:06.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 161.450210] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:06.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d5adec89403f254c6adc4e6","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d5adec89403f254c6adc4e6: start","job_status":"start","queue_duration_s":0.837206,"scheduling_latency_s":0.837228}1387gitlab # [ 161.454478] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d5adec89403f254c6adc4e6","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d5adec89403f254c6adc4e6: done: 0.212346 sec","job_status":"done","queue_duration_s":0.837206,"scheduling_latency_s":0.837228,"redis_calls":13,"redis_duration_s":0.0016349999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.212346,"completed_at":"2026-09-04T06:43:07.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 161.489221] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f99e2da0decb3b2335909069","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f99e2da0decb3b2335909069: start","job_status":"start","queue_duration_s":1.052794,"scheduling_latency_s":1.052809}1389gitlab # [ 161.500262] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f99e2da0decb3b2335909069","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f99e2da0decb3b2335909069: done: 0.143403 sec","job_status":"done","queue_duration_s":1.052794,"scheduling_latency_s":1.052809,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.143403,"completed_at":"2026-09-04T06:43:07.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 161.568867] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52e7792ca843f1e2048c1b5c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52e7792ca843f1e2048c1b5c: start","job_status":"start","queue_duration_s":1.19828,"scheduling_latency_s":1.198301}1391gitlab # [ 161.569563] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52e7792ca843f1e2048c1b5c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52e7792ca843f1e2048c1b5c: done: 0.117365 sec","job_status":"done","queue_duration_s":1.19828,"scheduling_latency_s":1.198301,"redis_calls":13,"redis_duration_s":0.002271,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001764,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.117365,"completed_at":"2026-09-04T06:43:07.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 161.614596] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c740e175464f90182f0f568d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c740e175464f90182f0f568d: start","job_status":"start","queue_duration_s":1.338939,"scheduling_latency_s":1.338962}1393gitlab # [ 161.615252] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c740e175464f90182f0f568d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c740e175464f90182f0f568d: done: 0.161963 sec","job_status":"done","queue_duration_s":1.338939,"scheduling_latency_s":1.338962,"redis_calls":13,"redis_duration_s":0.002107,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.161963,"completed_at":"2026-09-04T06:43:07.554Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 161.625530] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5106ed4b744c2c1538b0e32","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5106ed4b744c2c1538b0e32: start","job_status":"start","queue_duration_s":1.521002,"scheduling_latency_s":1.521024}1395gitlab # [ 161.636528] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5106ed4b744c2c1538b0e32","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5106ed4b744c2c1538b0e32: done: 0.038197 sec","job_status":"done","queue_duration_s":1.521002,"scheduling_latency_s":1.521024,"redis_calls":13,"redis_duration_s":0.014293,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.013052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038197,"completed_at":"2026-09-04T06:43:07.612Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 161.699626] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c9ddb29a195acbbf1975fbc","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c9ddb29a195acbbf1975fbc: start","job_status":"start","queue_duration_s":1.571909,"scheduling_latency_s":1.571928}1397gitlab # [ 161.700423] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c9ddb29a195acbbf1975fbc","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c9ddb29a195acbbf1975fbc: done: 0.063168 sec","job_status":"done","queue_duration_s":1.571909,"scheduling_latency_s":1.571928,"redis_calls":13,"redis_duration_s":0.051683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.050594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.063168,"completed_at":"2026-09-04T06:43:07.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 161.718281] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d23704ba92b907b1219d4a9","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d23704ba92b907b1219d4a9: start","job_status":"start","queue_duration_s":1.636094,"scheduling_latency_s":1.636112}1399gitlab # [ 161.729639] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d23704ba92b907b1219d4a9","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d23704ba92b907b1219d4a9: done: 0.047765 sec","job_status":"done","queue_duration_s":1.636094,"scheduling_latency_s":1.636112,"redis_calls":13,"redis_duration_s":0.001767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001223,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.047765,"completed_at":"2026-09-04T06:43:07.737Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 161.773619] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c9d9ff75b607848e45637a5","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c9d9ff75b607848e45637a5: start","job_status":"start","queue_duration_s":1.684785,"scheduling_latency_s":1.684801}1401gitlab # [ 161.775076] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c9d9ff75b607848e45637a5","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c9d9ff75b607848e45637a5: done: 0.009882 sec","job_status":"done","queue_duration_s":1.684785,"scheduling_latency_s":1.684801,"redis_calls":13,"redis_duration_s":0.0017929999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009882,"completed_at":"2026-09-04T06:43:07.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 161.810407] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f365d496615d79a2569362c7","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f365d496615d79a2569362c7: start","job_status":"start","queue_duration_s":1.695548,"scheduling_latency_s":1.695561}1403gitlab # [ 161.850904] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f365d496615d79a2569362c7","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f365d496615d79a2569362c7: done: 0.009801 sec","job_status":"done","queue_duration_s":1.695548,"scheduling_latency_s":1.695561,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009801,"completed_at":"2026-09-04T06:43:07.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 161.891459] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b636002c05c52ffbe9d26a3b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b636002c05c52ffbe9d26a3b: start","job_status":"start","queue_duration_s":1.706177,"scheduling_latency_s":1.706191}1405gitlab # [ 161.892157] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b636002c05c52ffbe9d26a3b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b636002c05c52ffbe9d26a3b: done: 0.009287 sec","job_status":"done","queue_duration_s":1.706177,"scheduling_latency_s":1.706191,"redis_calls":13,"redis_duration_s":0.0015140000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009287,"completed_at":"2026-09-04T06:43:07.768Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 161.900542] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdb50dc6146fc8fff01a0c48","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdb50dc6146fc8fff01a0c48: start","job_status":"start","queue_duration_s":1.716423,"scheduling_latency_s":1.716437}1407gitlab # [ 161.942751] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdb50dc6146fc8fff01a0c48","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdb50dc6146fc8fff01a0c48: done: 0.009505 sec","job_status":"done","queue_duration_s":1.716423,"scheduling_latency_s":1.716437,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009505,"completed_at":"2026-09-04T06:43:07.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 161.945721] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eb82cb145af2560fe11d12d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eb82cb145af2560fe11d12d: start","job_status":"start","queue_duration_s":1.726931,"scheduling_latency_s":1.726944}1409gitlab # [ 161.992874] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eb82cb145af2560fe11d12d","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eb82cb145af2560fe11d12d: done: 0.009562 sec","job_status":"done","queue_duration_s":1.726931,"scheduling_latency_s":1.726944,"redis_calls":13,"redis_duration_s":0.001491,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009562,"completed_at":"2026-09-04T06:43:07.789Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 161.993966] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96b7edf832dace65841fb58c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96b7edf832dace65841fb58c: start","job_status":"start","queue_duration_s":1.737472,"scheduling_latency_s":1.737485}1411gitlab # [ 162.032822] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96b7edf832dace65841fb58c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96b7edf832dace65841fb58c: done: 0.009745 sec","job_status":"done","queue_duration_s":1.737472,"scheduling_latency_s":1.737485,"redis_calls":13,"redis_duration_s":0.001695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009745,"completed_at":"2026-09-04T06:43:07.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 162.036117] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd3ed6c28e5a897e68e2d32","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd3ed6c28e5a897e68e2d32: start","job_status":"start","queue_duration_s":1.748192,"scheduling_latency_s":1.748206}1413gitlab # [ 162.047536] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd3ed6c28e5a897e68e2d32","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd3ed6c28e5a897e68e2d32: done: 0.009429 sec","job_status":"done","queue_duration_s":1.748192,"scheduling_latency_s":1.748206,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009429,"completed_at":"2026-09-04T06:43:07.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 162.082425] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55d07ce51e186f822dbe337c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55d07ce51e186f822dbe337c: start","job_status":"start","queue_duration_s":1.758621,"scheduling_latency_s":1.758634}1415gitlab # [ 162.126656] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55d07ce51e186f822dbe337c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55d07ce51e186f822dbe337c: done: 0.009527 sec","job_status":"done","queue_duration_s":1.758621,"scheduling_latency_s":1.758634,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009527,"completed_at":"2026-09-04T06:43:07.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 162.127625] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"295ba431e780b00f87f61f4c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-295ba431e780b00f87f61f4c: start","job_status":"start","queue_duration_s":1.769107,"scheduling_latency_s":1.769121}1417gitlab # [ 162.138632] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"295ba431e780b00f87f61f4c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-295ba431e780b00f87f61f4c: done: 0.009424 sec","job_status":"done","queue_duration_s":1.769107,"scheduling_latency_s":1.769121,"redis_calls":13,"redis_duration_s":0.0015079999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009424,"completed_at":"2026-09-04T06:43:07.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 162.203465] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b0028c8c421bbd9af84eb91","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b0028c8c421bbd9af84eb91: start","job_status":"start","queue_duration_s":1.779423,"scheduling_latency_s":1.779435}1419gitlab # [ 162.204233] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b0028c8c421bbd9af84eb91","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b0028c8c421bbd9af84eb91: done: 0.009593 sec","job_status":"done","queue_duration_s":1.779423,"scheduling_latency_s":1.779435,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009593,"completed_at":"2026-09-04T06:43:07.842Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 162.255659] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ee4de0b6d44b803f36a6076","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ee4de0b6d44b803f36a6076: start","job_status":"start","queue_duration_s":1.789846,"scheduling_latency_s":1.78986}1421gitlab # [ 162.256455] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ee4de0b6d44b803f36a6076","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ee4de0b6d44b803f36a6076: done: 0.009594 sec","job_status":"done","queue_duration_s":1.789846,"scheduling_latency_s":1.78986,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009594,"completed_at":"2026-09-04T06:43:07.852Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 162.263668] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"825b4a8d7dff5ea6568b3d35","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-825b4a8d7dff5ea6568b3d35: start","job_status":"start","queue_duration_s":1.800254,"scheduling_latency_s":1.800267}1423gitlab # [ 162.274895] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"825b4a8d7dff5ea6568b3d35","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-825b4a8d7dff5ea6568b3d35: done: 0.009501 sec","job_status":"done","queue_duration_s":1.800254,"scheduling_latency_s":1.800267,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009501,"completed_at":"2026-09-04T06:43:07.863Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 162.309847] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ad2edd92cb36cac1d3d6efb","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ad2edd92cb36cac1d3d6efb: start","job_status":"start","queue_duration_s":1.810585,"scheduling_latency_s":1.810597}1425gitlab # [ 162.321113] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ad2edd92cb36cac1d3d6efb","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ad2edd92cb36cac1d3d6efb: done: 0.009603 sec","job_status":"done","queue_duration_s":1.810585,"scheduling_latency_s":1.810597,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009603,"completed_at":"2026-09-04T06:43:07.873Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 162.361628] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faaec7ef57f1b1be11312dee","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faaec7ef57f1b1be11312dee: start","job_status":"start","queue_duration_s":1.820996,"scheduling_latency_s":1.821009}1427gitlab # [ 162.366883] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faaec7ef57f1b1be11312dee","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faaec7ef57f1b1be11312dee: done: 0.009296 sec","job_status":"done","queue_duration_s":1.820996,"scheduling_latency_s":1.821009,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009296,"completed_at":"2026-09-04T06:43:07.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 162.415351] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b294727be2871fc8be6164dc","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b294727be2871fc8be6164dc: start","job_status":"start","queue_duration_s":1.831277,"scheduling_latency_s":1.83129}1429gitlab # [ 162.415914] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b294727be2871fc8be6164dc","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b294727be2871fc8be6164dc: done: 0.009479 sec","job_status":"done","queue_duration_s":1.831277,"scheduling_latency_s":1.83129,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009479,"completed_at":"2026-09-04T06:43:07.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 162.446894] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d32327f1ca6b46e010a43af9","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d32327f1ca6b46e010a43af9: start","job_status":"start","queue_duration_s":1.84173,"scheduling_latency_s":1.841743}1431gitlab # [ 162.457947] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d32327f1ca6b46e010a43af9","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d32327f1ca6b46e010a43af9: done: 0.009641 sec","job_status":"done","queue_duration_s":1.84173,"scheduling_latency_s":1.841743,"redis_calls":13,"redis_duration_s":0.001687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009641,"completed_at":"2026-09-04T06:43:07.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 162.492990] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d85d2dd992d5643f11f5a65c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d85d2dd992d5643f11f5a65c: start","job_status":"start","queue_duration_s":1.852346,"scheduling_latency_s":1.85236}1433gitlab # [ 162.533745] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d85d2dd992d5643f11f5a65c","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d85d2dd992d5643f11f5a65c: done: 0.009375 sec","job_status":"done","queue_duration_s":1.852346,"scheduling_latency_s":1.85236,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009375,"completed_at":"2026-09-04T06:43:07.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 162.538093] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd843312a5996fa3c685011b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd843312a5996fa3c685011b: start","job_status":"start","queue_duration_s":1.862732,"scheduling_latency_s":1.862745}1435gitlab # [ 162.549245] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd843312a5996fa3c685011b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd843312a5996fa3c685011b: done: 0.009408 sec","job_status":"done","queue_duration_s":1.862732,"scheduling_latency_s":1.862745,"redis_calls":13,"redis_duration_s":0.0015049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009408,"completed_at":"2026-09-04T06:43:07.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 162.610488] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e543e031a6bf10a1a7f0fb36","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e543e031a6bf10a1a7f0fb36: start","job_status":"start","queue_duration_s":1.873201,"scheduling_latency_s":1.873215}1437gitlab # [ 162.611230] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e543e031a6bf10a1a7f0fb36","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e543e031a6bf10a1a7f0fb36: done: 0.013998 sec","job_status":"done","queue_duration_s":1.873201,"scheduling_latency_s":1.873215,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013998,"completed_at":"2026-09-04T06:43:07.940Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 162.629485] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec2d33b56c7c5dfd9f6a6b3b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec2d33b56c7c5dfd9f6a6b3b: start","job_status":"start","queue_duration_s":1.887999,"scheduling_latency_s":1.888012}1439gitlab # [ 162.640293] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec2d33b56c7c5dfd9f6a6b3b","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec2d33b56c7c5dfd9f6a6b3b: done: 0.010274 sec","job_status":"done","queue_duration_s":1.887999,"scheduling_latency_s":1.888012,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010274,"completed_at":"2026-09-04T06:43:07.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 162.690181] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7740dbf755a9c4da3d91597","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7740dbf755a9c4da3d91597: start","job_status":"start","queue_duration_s":1.899116,"scheduling_latency_s":1.89913}1441gitlab # [ 162.690864] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7740dbf755a9c4da3d91597","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7740dbf755a9c4da3d91597: done: 0.009538 sec","job_status":"done","queue_duration_s":1.899116,"scheduling_latency_s":1.89913,"redis_calls":13,"redis_duration_s":0.001665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009538,"completed_at":"2026-09-04T06:43:07.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 162.744168] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4efe732acb31bded68916750","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4efe732acb31bded68916750: start","job_status":"start","queue_duration_s":1.90959,"scheduling_latency_s":1.909604}1443gitlab # [ 162.744902] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4efe732acb31bded68916750","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4efe732acb31bded68916750: done: 0.009327 sec","job_status":"done","queue_duration_s":1.90959,"scheduling_latency_s":1.909604,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009327,"completed_at":"2026-09-04T06:43:07.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 162.792716] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"678dc284f4071ae2ec27a37f","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-678dc284f4071ae2ec27a37f: start","job_status":"start","queue_duration_s":1.919889,"scheduling_latency_s":1.919902}1445gitlab # [ 162.793944] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"678dc284f4071ae2ec27a37f","created_at":"2026-09-04T06:43:05.974Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fedf23bc11f145ef","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6146c2f1557163cb190493815a655df0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.053Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-678dc284f4071ae2ec27a37f: done: 0.009385 sec","job_status":"done","queue_duration_s":1.919889,"scheduling_latency_s":1.919902,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009385,"completed_at":"2026-09-04T06:43:07.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 162.833734] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.983Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f8b22914a07389522b34b41b","created_at":"2026-09-04T06:43:06.446Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fae73dd5514645e4","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f8b22914a07389522b34b41b: start","job_status":"start","queue_duration_s":1.526961,"scheduling_latency_s":1.526974}1447gitlab # [ 162.834608] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:07.994Z","message":"No existing merge request to be cleaned up."}1448gitlab # [ 162.835140] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.003Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f8b22914a07389522b34b41b","created_at":"2026-09-04T06:43:06.446Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fae73dd5514645e4","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f8b22914a07389522b34b41b: done: 0.020161 sec","job_status":"done","queue_duration_s":1.526961,"scheduling_latency_s":1.526974,"redis_calls":13,"redis_duration_s":0.001644,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217905,"duration_s":0.020161,"completed_at":"2026-09-04T06:43:08.003Z","load_balancing_strategy":"primary","db_duration_s":0.004002,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 162.881584] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.004Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"644d4c00bbc412caf2b563af","created_at":"2026-09-04T06:43:06.446Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fae73dd5514645e4","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-644d4c00bbc412caf2b563af: start","job_status":"start","queue_duration_s":1.547976,"scheduling_latency_s":1.54799}1450gitlab # [ 162.881942] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.012Z","message":"No existing merge request to be cleaned up."}1451gitlab # [ 162.882577] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.018Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"644d4c00bbc412caf2b563af","created_at":"2026-09-04T06:43:06.446Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fae73dd5514645e4","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-644d4c00bbc412caf2b563af: done: 0.01377 sec","job_status":"done","queue_duration_s":1.547976,"scheduling_latency_s":1.54799,"redis_calls":10,"redis_duration_s":0.001253,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01377,"completed_at":"2026-09-04T06:43:08.018Z","load_balancing_strategy":"primary","db_duration_s":0.003907,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 162.935941] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.019Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"153930cdb5b03f9aff62c185","created_at":"2026-09-04T06:43:06.446Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fae73dd5514645e4","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-153930cdb5b03f9aff62c185: start","job_status":"start","queue_duration_s":1.562632,"scheduling_latency_s":1.562646}1453gitlab # [ 162.936640] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.027Z","message":"No existing merge request to be cleaned up."}1454gitlab # [ 162.937230] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.033Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"153930cdb5b03f9aff62c185","created_at":"2026-09-04T06:43:06.446Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fae73dd5514645e4","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-153930cdb5b03f9aff62c185: done: 0.013746 sec","job_status":"done","queue_duration_s":1.562632,"scheduling_latency_s":1.562646,"redis_calls":10,"redis_duration_s":0.001535,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013746,"completed_at":"2026-09-04T06:43:08.032Z","load_balancing_strategy":"primary","db_duration_s":0.004432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 162.983760] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.033Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f7ba1d468d2f2a7f86ee668","created_at":"2026-09-04T06:43:06.446Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fae73dd5514645e4","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f7ba1d468d2f2a7f86ee668: start","job_status":"start","queue_duration_s":1.577198,"scheduling_latency_s":1.577211}1456gitlab # [ 162.984624] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.041Z","message":"No existing merge request to be cleaned up."}1457gitlab # [ 162.985142] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:08.045Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f7ba1d468d2f2a7f86ee668","created_at":"2026-09-04T06:43:06.446Z","trace_propagation_headers":{"sentry-trace":"0d1eeca6cf064aae80fa7c6a43a8cb71-fae73dd5514645e4","baggage":"sentry-trace_id=0d1eeca6cf064aae80fa7c6a43a8cb71,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3bc75ece7c8ed0bc7caade54f68d2bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:06.456Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f7ba1d468d2f2a7f86ee668: done: 0.011727 sec","job_status":"done","queue_duration_s":1.577198,"scheduling_latency_s":1.577211,"redis_calls":10,"redis_duration_s":0.0012980000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011727,"completed_at":"2026-09-04T06:43:08.045Z","load_balancing_strategy":"primary","db_duration_s":0.00181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 163.182690] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2770737857 wd_nsec: 27707375751459gitlab # [ 181.689264] postgres[2416]: [2416] ERROR: relation "table_without_models" does not exist1460gitlab # [ 181.690647] postgres[2416]: [2416] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1461gitlab # [ 185.130202] runuser[2214]: pam_unix(runuser:session): session closed for user gitlab1462gitlab # [ 185.132696] setup-gitlab-start[2192]: + systemctl restart gitlab-sidekiq.service1463gitlab # [ 185.160151] systemd[1]: Stopping gitlab-sidekiq.service...1464gitlab # [ 185.161560] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:31.464Z","message":"Shutting down"}1465gitlab # [ 185.162597] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:31.464Z","message":"Scheduler exiting..."}1466gitlab # [ 185.163666] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:31.466Z","message":"Terminating quiet threads for default capsule"}1467gitlab # [ 185.164044] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:31.466Z","message":"Scheduler exiting..."}1468gitlab # [ 185.663723] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:31.967Z","message":"Pausing to allow jobs to finish..."}1469gitlab # [ 187.166104] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:33.469Z","message":"Bye!"}1470gitlab # [ 187.188651] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-09-04T06:43:33.492Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1614,"worker_id":"sidekiq_0","memwd_rss_bytes":946536448,"retry":0}1471gitlab # [ 188.093500] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1472gitlab # [ 188.096188] systemd[1]: Stopped gitlab-sidekiq.service.1473gitlab # [ 188.097941] systemd[1]: gitlab-sidekiq.service: Consumed 55.124s CPU time over 1min 55.045s wall clock time, 957.3M memory peak, 4.4M read from disk.1474gitlab # [ 188.107271] systemd[1]: Started gitlab-sidekiq.service.1475gitlab # [ 188.111236] setup-gitlab-start[2192]: + mkdir -p /var/lib/secrets1476gitlab # [ 188.114397] setup-gitlab-start[2192]: + echo nixbot-test-token-of-20-chars1477gitlab # [ 188.116604] setup-gitlab-start[2192]: + chmod 644 /var/lib/secrets/gitlab-token1478gitlab # [ 188.122328] setup-gitlab-start[2192]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1479gitlab # [ 189.017876] gitaly[900]: time="2026-09-04T06:43:35.321Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.321" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1480gitlab # [ 189.027119] gitaly[900]: time="2026-09-04T06:43:35.331Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.321" grpc.time_ms=9.349 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1481gitlab # [ 189.172152] gitaly[900]: time="2026-09-04T06:43:35.476Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.155" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.476" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1482gitlab # [ 189.190645] gitaly[900]: time="2026-09-04T06:43:35.476Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.155" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.476" grpc.time_ms=0.342 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1483gitlab # [ 189.252515] gitaly[900]: time="2026-09-04T06:43:35.556Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV diskcache=6050a74e-bc15-4eaa-8f71-f7f0b1305741 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T06:43:45.186" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.507" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1484gitlab # [ 189.267122] gitaly[900]: time="2026-09-04T06:43:35.557Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T06:43:45.186" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.507" grpc.time_ms=49.718 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1485gitlab # [ 189.279830] gitaly[900]: time="2026-09-04T06:43:35.583Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.263" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.583" pid=900 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1486gitlab # [ 189.289248] gitaly[900]: time="2026-09-04T06:43:35.583Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.263" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.583" grpc.time_ms=0.367 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1487gitlab # [ 189.299046] gitaly[900]: time="2026-09-04T06:43:35.600Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:43:45.268" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.589" grpc.time_ms=11.53 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 189.353094] gitaly[900]: time="2026-09-04T06:43:35.657Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.656" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 189.356604] gitaly[900]: time="2026-09-04T06:43:35.657Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.656" grpc.time_ms=0.386 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 189.404330] gitaly[900]: time="2026-09-04T06:43:35.708Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV diskcache=5318936e-d216-49cd-b5a1-e1be6778b792 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T06:43:45.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.659" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 189.405431] gitaly[900]: time="2026-09-04T06:43:35.708Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=32 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T06:43:45.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.659" grpc.time_ms=48.728 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1492gitlab # [ 189.410458] gitaly[900]: time="2026-09-04T06:43:35.714Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.064" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.714" pid=900 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1493gitlab # [ 189.411610] gitaly[900]: time="2026-09-04T06:43:35.714Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.064" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.714" grpc.time_ms=0.417 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 189.422979] gitaly[900]: time="2026-09-04T06:43:35.727Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:43:45.067" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.718" grpc.time_ms=9.08 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 189.443607] gitaly[900]: time="2026-09-04T06:43:35.747Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:43:45.097" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.747" grpc.time_ms=0.098 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 189.447388] gitaly[900]: time="2026-09-04T06:43:35.751Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T06:43:45.101" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:35.751" grpc.time_ms=0.14 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 189.864835] gitaly[900]: time="2026-09-04T06:43:36.169Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH2XHN6PH7VDT60YW05NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:43:46.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:36.158" grpc.time_ms=10.052 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 190.252823] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:36 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 21071499gitlab # [ 190.257801] setup-gitlab-start[2192]: + mkdir -p /tmp/test-flake1500gitlab # [ 190.262308] setup-gitlab-start[2192]: + cd /tmp/test-flake1501gitlab # [ 190.264120] setup-gitlab-start[2192]: + git init -b master1502gitlab # [ 190.287391] setup-gitlab-start[2503]: Initialized empty Git repository in /tmp/test-flake/.git/1503gitlab # [ 190.289227] setup-gitlab-start[2192]: + git config user.name test1504gitlab # [ 190.296127] setup-gitlab-start[2192]: + git config user.email test@example.com1505gitlab # [ 190.302453] setup-gitlab-start[2192]: + cat1506gitlab # [ 190.307113] setup-gitlab-start[2192]: + git add flake.nix1507gitlab # [ 190.313894] setup-gitlab-start[2192]: + git commit -m 'initial commit'1508gitlab # [ 190.337844] setup-gitlab-start[2508]: [master (root-commit) e441c53] initial commit1509gitlab # [ 190.340815] setup-gitlab-start[2508]: 1 file changed, 10 insertions(+)1510gitlab # [ 190.343329] setup-gitlab-start[2508]: create mode 100644 flake.nix1511gitlab # [ 190.345096] setup-gitlab-start[2192]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1512gitlab # [ 190.346191] setup-gitlab-start[2192]: + git push -u origin master1513gitlab # [ 190.406594] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:36 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 311514gitlab # [ 190.669158] gitaly[900]: time="2026-09-04T06:43:36.973Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH54CQ28D4NN8BWXMY7YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:36.961" grpc.time_ms=11.296 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1515gitlab # [ 190.698059] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2571516gitlab # [ 190.945404] gitaly[900]: time="2026-09-04T06:43:37.249Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:43:47.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:37.241" grpc.time_ms=8.11 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1517gitlab # [ 191.007877] gitaly[900]: time="2026-09-04T06:43:37.312Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T06:44:07.001" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T06:43:37.301" grpc.time_ms=10.332 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1518gitlab # [ 191.055599] gitaly[900]: time="2026-09-04T06:43:37.359Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NJH5DR85A82QE4WM7816B4 duration_ms=201ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/allowed"1519gitlab # [ 191.100571] gitaly[900]: time="2026-09-04T06:43:37.404Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NJH5DR85A82QE4WM7816B4 duration_ms=39ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/pre_receive"1520gitlab # [ 191.108051] gitaly[900]: time="2026-09-04T06:43:37.412Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:37.158" grpc.time_ms=253.735 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1521gitlab # [ 191.134529] sidekiq-cluster[2454]: {"severity":"INFO","time":"2026-09-04T06:43:37.421Z","message":"Starting cluster with 1 processes"}1522gitlab # [ 191.177817] gitaly[900]: time="2026-09-04T06:43:37.482Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:37.481" grpc.time_ms=0.938 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1523gitlab # [ 191.224614] gitaly[900]: time="2026-09-04T06:43:37.528Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:37.527" grpc.time_ms=0.375 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1524gitlab # [ 191.268152] gitaly[900]: time="2026-09-04T06:43:37.572Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:37.572" grpc.time_ms=0.25 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1525gitlab # [ 191.384317] gitaly[900]: time="2026-09-04T06:43:37.688Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:43:47.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:37.679" grpc.time_ms=8.446 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1526gitlab # [ 191.443289] gitaly[900]: time="2026-09-04T06:43:37.747Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1568 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T06:43:47.052" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:43:37.722" grpc.time_ms=24.415 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1527gitlab # [ 191.478747] gitaly[900]: time="2026-09-04T06:43:37.782Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NJH5DR85A82QE4WM7816B4 duration_ms=172ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/post_receive"1528gitlab # [ 191.484454] gitaly[900]: time="2026-09-04T06:43:37.788Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:37.609" grpc.time_ms=178.95 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1529gitlab # [ 191.509874] gitaly[900]: time="2026-09-04T06:43:37.814Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 diskcache=0d7e6870-62e2-49d8-b27a-44ba363a5dcb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:37.104" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1530gitlab # [ 191.510506] gitaly[900]: time="2026-09-04T06:43:37.814Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=186 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=14000 command.oublock=32 command.real_time_ms=699 command.spawn_token_fork_ms=0 command.system_time_ms=124 command.user_time_ms=62 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:37.104" grpc.time_ms=709.445 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1531gitlab # [ 191.511613] gitlab-workhorse[826]: time="2026-09-04T06:43:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521532gitlab # [ 191.512220] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:37 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7981533gitlab # [ 191.514167] setup-gitlab-start[2512]: To http://gitlab/root/test-flake.git1534gitlab # [ 191.514942] setup-gitlab-start[2512]: * [new branch] master -> master1535gitlab # [ 191.516712] setup-gitlab-start[2512]: branch 'master' set up to track 'origin/master'.1536gitlab # [ 191.538123] systemd[1]: Finished setup-gitlab.service.1537gitlab # [ 191.540312] systemd[1]: Starting nixbot CI service...1538gitlab: (finished: waiting for unit setup-gitlab.service, in 192.45 seconds)1539gitlab: waiting for unit nixbot.service1540gitlab # [ 192.699772] nixbot[2605]: {"ts": "2026-09-04T06:43:39.003Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1541gitlab # [ 192.722947] nixbot[2605]: {"ts": "2026-09-04T06:43:39.027Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1542gitlab # [ 192.754626] nixbot[2605]: {"ts": "2026-09-04T06:43:39.058Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1543gitlab # [ 192.764780] nixbot[2605]: {"ts": "2026-09-04T06:43:39.068Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1544gitlab # [ 192.774235] nixbot[2605]: {"ts": "2026-09-04T06:43:39.078Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1545gitlab # [ 192.783679] nixbot[2605]: {"ts": "2026-09-04T06:43:39.087Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1546gitlab # [ 192.793566] nixbot[2605]: {"ts": "2026-09-04T06:43:39.097Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1547gitlab # [ 192.796780] nixbot[2605]: {"ts": "2026-09-04T06:43:39.100Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1548gitlab # [ 192.805486] nixbot[2605]: {"ts": "2026-09-04T06:43:39.109Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1549gitlab # [ 192.813356] nixbot[2605]: {"ts": "2026-09-04T06:43:39.117Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1550gitlab # [ 192.821589] nixbot[2605]: {"ts": "2026-09-04T06:43:39.125Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1551gitlab # [ 192.830497] nixbot[2605]: {"ts": "2026-09-04T06:43:39.134Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1552gitlab # [ 192.840390] nixbot[2605]: {"ts": "2026-09-04T06:43:39.144Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1553gitlab # [ 192.843652] nixbot[2605]: {"ts": "2026-09-04T06:43:39.147Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1554gitlab # [ 192.855922] nixbot[2605]: {"ts": "2026-09-04T06:43:39.160Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1555gitlab # [ 192.859406] nixbot[2605]: {"ts": "2026-09-04T06:43:39.163Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1556gitlab # [ 192.862610] nixbot[2605]: {"ts": "2026-09-04T06:43:39.166Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1557gitlab # [ 192.865372] nixbot[2605]: {"ts": "2026-09-04T06:43:39.169Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1558gitlab # [ 192.872129] nixbot[2605]: {"ts": "2026-09-04T06:43:39.176Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1559gitlab # [ 192.875085] nixbot[2605]: {"ts": "2026-09-04T06:43:39.179Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1560gitlab # [ 192.877964] nixbot[2605]: {"ts": "2026-09-04T06:43:39.182Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1561gitlab # [ 192.885298] nixbot[2605]: {"ts": "2026-09-04T06:43:39.189Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1562gitlab # [ 192.888162] nixbot[2605]: {"ts": "2026-09-04T06:43:39.191Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1563gitlab # [ 192.891322] nixbot[2605]: {"ts": "2026-09-04T06:43:39.195Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1564gitlab # [ 192.894386] nixbot[2605]: {"ts": "2026-09-04T06:43:39.198Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1565gitlab # [ 192.899104] nixbot[2605]: {"ts": "2026-09-04T06:43:39.203Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1566gitlab # [ 192.903671] nixbot[2605]: {"ts": "2026-09-04T06:43:39.207Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1567gitlab # [ 192.907746] nixbot[2605]: {"ts": "2026-09-04T06:43:39.211Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1568gitlab # [ 192.912159] nixbot[2605]: {"ts": "2026-09-04T06:43:39.216Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1569gitlab # [ 192.919995] nixbot[2605]: {"ts": "2026-09-04T06:43:39.224Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1570gitlab # [ 192.925837] nixbot[2605]: {"ts": "2026-09-04T06:43:39.230Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1571gitlab # [ 192.928985] nixbot[2605]: {"ts": "2026-09-04T06:43:39.233Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1572gitlab # [ 193.274524] nixbot[2605]: INFO: Started server process [2605]1573gitlab # [ 193.276164] nixbot[2605]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1574gitlab # [ 193.293388] nixbot[2605]: INFO: ::ffff:127.0.0.1:47048 - "GET /health HTTP/1.1" 200 OK1575gitlab # [ 193.301607] systemd[1]: Started nixbot CI service.1576gitlab # [ 193.303612] systemd[1]: Reached target Multi-User System.1577gitlab # [ 193.305845] systemd[1]: Startup finished in 1.187s (kernel) + 3.563s (initrd) + 3min 8.554s (userspace) = 3min 13.305s.1578gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1579gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1580gitlab # [ 193.961657] nixbot[2605]: INFO: ::ffff:127.0.0.1:54472 - "GET /health HTTP/1.1" 200 OK1581gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1582subtest: project discovered and webhook registered1583gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1584gitlab # [ 193.969971] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:40 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 6761585gitlab # [ 193.975117] nixbot[2605]: {"ts": "2026-09-04T06:43:40.277Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1586gitlab # [ 193.987918] nixbot[2605]: {"ts": "2026-09-04T06:43:40.292Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1587gitlab # [ 194.041596] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 451588gitlab # [ 194.044078] nixbot[2605]: {"ts": "2026-09-04T06:43:40.348Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1589gitlab # [ 194.047462] nixbot[2605]: {"ts": "2026-09-04T06:43:40.351Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1590gitlab # [ 194.050587] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 631591gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1592gitlab # [ 194.179955] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1271593gitlab # [ 194.181636] nixbot[2605]: {"ts": "2026-09-04T06:43:40.484Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1594gitlab # [ 194.332821] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:40 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1371595gitlab # [ 194.338618] nixbot[2605]: {"ts": "2026-09-04T06:43:40.637Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1596gitlab # [ 194.437737] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 961597gitlab # [ 194.439332] nixbot[2605]: {"ts": "2026-09-04T06:43:40.743Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1598gitlab # [ 194.532175] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:40 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 851599gitlab # [ 194.534180] nixbot[2605]: {"ts": "2026-09-04T06:43:40.835Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1600gitlab # [ 194.585806] gitaly[900]: time="2026-09-04T06:43:40.889Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH95CGJHNYNAG3HCG34RT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-04T06:44:10.575" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:43:40.876" grpc.time_ms=12.688 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1601gitlab # [ 194.633465] gitaly[900]: time="2026-09-04T06:43:40.937Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH95CGJHNYNAG3HCG34RT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:44:10.636" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:43:40.936" grpc.time_ms=0.877 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1602gitlab # [ 194.674939] gitaly[900]: time="2026-09-04T06:43:40.979Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH95CGJHNYNAG3HCG34RT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-04T06:43:50.006" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:43:40.967" grpc.time_ms=11.777 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1603gitlab # [ 194.702788] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1621604gitlab # [ 194.705083] nixbot[2605]: {"ts": "2026-09-04T06:43:41.007Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1605gitlab # [ 194.763436] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 561606gitlab # [ 194.768844] nixbot[2605]: {"ts": "2026-09-04T06:43:41.068Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1607gitlab # [ 194.769447] nixbot[2605]: {"ts": "2026-09-04T06:43:41.071Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1608gitlab # [ 194.852714] gitaly[900]: time="2026-09-04T06:43:41.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9DN0FD0JPMJ0E99RNWF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.145" grpc.time_ms=11.698 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1609gitlab # [ 194.881779] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 761610gitlab # [ 194.958753] gitaly[900]: time="2026-09-04T06:43:41.263Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9G8V4MRBTKVKZH79VYF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.252" pid=900 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1611gitlab # [ 194.959592] gitaly[900]: time="2026-09-04T06:43:41.263Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9G8V4MRBTKVKZH79VYF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.252" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1612gitlab # [ 194.960629] gitaly[900]: time="2026-09-04T06:43:41.263Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9G8V4MRBTKVKZH79VYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.252" grpc.time_ms=11.368 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1613gitlab # [ 194.961917] gitlab-workhorse[826]: time="2026-09-04T06:43:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131614gitlab # [ 194.962828] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 721615gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1616gitlab # [ 195.108274] gitaly[900]: time="2026-09-04T06:43:41.412Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9MM1ZBT1WSDA09ZYQYK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.396" pid=900 remote_ip="2001:db8:1::1" request_sha=f52f175998c595ca95ff33627904e76c80614352 response_bytes=229 span.kind=server system=grpc1617gitlab # [ 195.110244] gitaly[900]: time="2026-09-04T06:43:41.412Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9MM1ZBT1WSDA09ZYQYK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.396" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1618gitlab # [ 195.114247] gitaly[900]: time="2026-09-04T06:43:41.412Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9MM1ZBT1WSDA09ZYQYK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.396" grpc.time_ms=16.029 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1619gitlab # [ 195.161084] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 811620gitlab # [ 195.161694] gitlab-workhorse[826]: time="2026-09-04T06:43:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2291621gitlab # [ 195.162164] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 229 "" "git/2.55.0" 1331622gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1623(finished: subtest: project discovered and webhook registered, in 1.21 seconds)1624subtest: push delivers the webhook1625gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1626gitlab # [ 195.222592] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 281627gitlab # [ 195.236975] gitaly[900]: time="2026-09-04T06:43:41.541Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9SZMMT38RETD3GA8ZT3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.535" grpc.time_ms=5.429 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1628gitlab # [ 195.249048] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 481629gitlab # [ 195.289350] gitaly[900]: time="2026-09-04T06:43:41.593Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9TSMM0Z0634J2XWB50Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.585" grpc.time_ms=7.89 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1630gitlab # [ 195.291774] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 651631gitlab # Enumerating objects: 5, done.1632gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1633gitlab # Delta compression using up to 4 threads1634gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1635gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 272 bytes | 272.00 KiB/s, done.1636gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1637gitlab # [ 195.349254] gitaly[900]: time="2026-09-04T06:43:41.653Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9VKHZWCK28ZPFJBRGZ9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.644" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1638gitlab # [ 195.350180] gitaly[900]: time="2026-09-04T06:43:41.653Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9VKHZWCK28ZPFJBRGZ9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.644" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1639gitlab # [ 195.350891] gitlab-workhorse[826]: time="2026-09-04T06:43:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671640gitlab # [ 195.351519] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 981641gitlab # [ 195.373296] gitaly[900]: time="2026-09-04T06:43:41.677Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9VKHZWCK28ZPFJBRGZ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.644" grpc.time_ms=8.815 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1642gitlab # [ 195.446339] gitaly[900]: time="2026-09-04T06:43:41.750Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA0F3AN7NA0E0CES171W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.744" grpc.time_ms=5.62 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1643gitlab # [ 195.449684] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421644gitlab # [ 195.490488] gitaly[900]: time="2026-09-04T06:43:41.794Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T06:44:11.088" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T06:43:41.788" grpc.time_ms=5.921 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1645gitlab # [ 195.512555] gitaly[900]: time="2026-09-04T06:43:41.816Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA24T662M0KYCKP7PDC6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.807" pid=900 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1646gitlab # [ 195.513281] gitaly[900]: time="2026-09-04T06:43:41.816Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA24T662M0KYCKP7PDC6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.807" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1647gitlab # [ 195.515658] gitaly[900]: time="2026-09-04T06:43:41.819Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY duration_ms=85ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/allowed"1648gitlab # [ 195.519227] gitaly[900]: time="2026-09-04T06:43:41.823Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA24T662M0KYCKP7PDC6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.807" grpc.time_ms=15.515 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1649gitlab # [ 195.530882] gitaly[900]: time="2026-09-04T06:43:41.835Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY duration_ms=15ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/pre_receive"1650gitlab # [ 195.532421] gitaly[900]: time="2026-09-04T06:43:41.836Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:41.733" grpc.time_ms=102.613 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1651gitlab # [ 195.560574] gitlab-workhorse[826]: time="2026-09-04T06:43:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091652gitlab # [ 195.562527] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1001653gitlab # [ 195.579641] gitaly[900]: time="2026-09-04T06:43:41.883Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:41.883" grpc.time_ms=0.862 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1654gitlab # [ 195.610840] gitaly[900]: time="2026-09-04T06:43:41.914Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:41.914" grpc.time_ms=0.662 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1655gitlab # [ 195.648884] gitaly[900]: time="2026-09-04T06:43:41.953Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:41.952" grpc.time_ms=0.254 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1656gitlab # [ 195.650976] gitaly[900]: time="2026-09-04T06:43:41.955Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:44:11.654" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:43:41.954" grpc.time_ms=0.496 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 195.677546] gitaly[900]: time="2026-09-04T06:43:41.981Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T06:44:11.675" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:43:41.975" grpc.time_ms=6.496 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 195.693162] gitaly[900]: time="2026-09-04T06:43:41.997Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:43:51.032" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:43:41.992" grpc.time_ms=5.059 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 195.717499] gitaly[900]: time="2026-09-04T06:43:42.021Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:43:52.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:43:42.014" grpc.time_ms=6.867 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1660gitlab # [ 195.749598] gitaly[900]: time="2026-09-04T06:43:42.053Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY duration_ms=41ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/post_receive"1661gitlab # [ 195.750954] gitaly[900]: time="2026-09-04T06:43:42.054Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:42.012" grpc.time_ms=41.887 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1662gitlab # [ 195.767576] gitaly[900]: time="2026-09-04T06:43:42.071Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T06:43:52.061" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:42.071" grpc.time_ms=0.177 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1663gitlab # [ 195.777439] gitaly[900]: time="2026-09-04T06:43:42.081Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T06:43:52.066" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:43:42.076" grpc.time_ms=4.729 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1664gitlab # [ 195.780742] gitaly[900]: time="2026-09-04T06:43:42.085Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY diskcache=596da1fc-9056-4ee9-9e9a-070e1fe6ebbb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.677" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1665gitlab # [ 195.781550] gitaly[900]: time="2026-09-04T06:43:42.085Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=158 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13249 command.oublock=32 command.real_time_ms=388 command.spawn_token_fork_ms=0 command.system_time_ms=128 command.user_time_ms=30 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=604 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:41.677" grpc.time_ms=407.637 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1666gitlab # [ 195.782170] gitlab-workhorse[826]: time="2026-09-04T06:43:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521667gitlab # [ 195.782568] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:42 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4651668gitlab # To http://gitlab/root/test-flake.git1669gitlab # e441c53..5802e58 master -> master1670gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.66 seconds)1671gitlab: must succeed: git -C /tmp/test-flake rev-parse master1672gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1673gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1674gitlab # [ 195.843092] gitaly[900]: time="2026-09-04T06:43:42.147Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:42.146" grpc.time_ms=0.307 pid=900 span.kind=server system=grpc1675gitlab # [ 195.871749] gitaly[900]: time="2026-09-04T06:43:42.176Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:43:42.172" grpc.time_ms=3.108 pid=900 span.kind=server system=grpc1676gitlab # [ 195.890815] gitaly[900]: time="2026-09-04T06:43:42.193Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW diskcache=225080d3-f37f-4895-a9c1-157ab95381f2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:43:52.110" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:42.120" pid=900 ref=refs/keep-around/e441c531bcadf2c8ccc5f608d9337067130f1e75 remote_ip="2001:db8:1::1" revision=e441c531bcadf2c8ccc5f608d9337067130f1e75 span.kind=server system=grpc username=root1677gitlab # [ 195.891466] gitaly[900]: time="2026-09-04T06:43:42.193Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=48 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5458 command.oublock=8 command.real_time_ms=64 command.spawn_token_fork_ms=0 command.system_time_ms=30 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:43:52.110" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:43:42.120" grpc.time_ms=72.921 pid=900 ref=refs/keep-around/e441c531bcadf2c8ccc5f608d9337067130f1e75 remote_ip="2001:db8:1::1" revision=e441c531bcadf2c8ccc5f608d9337067130f1e75 span.kind=server system=grpc username=root1678gitlab # [ 195.893688] nixbot[2605]: INFO: ::ffff:127.0.0.1:54482 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1679gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.08 seconds)1680gitlab # [ 195.916420] gitaly[900]: time="2026-09-04T06:43:42.220Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:44:12.119" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:43:42.220" grpc.time_ms=0.31 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab # [ 196.017319] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4101682gitlab # [ 196.019288] nixbot[2605]: {"ts": "2026-09-04T06:43:42.320Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 \"HTTP/1.1 201 Created\""}1683gitlab # [ 196.033102] nixbot[2605]: {"ts": "2026-09-04T06:43:42.337Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e441c531bcad-0"}1684gitlab # [ 196.206571] nixbot[2605]: {"ts": "2026-09-04T06:43:42.510Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e441c531bcad-0", "argv0": "bwrap"}1685gitlab # [ 196.301868] systemd[1]: Started Nix Daemon.1686gitlab # [ 196.362233] nix-daemon[2833]: accepted connection from pid 2828, user nixbot1687gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1688gitlab # [ 196.951885] nixbot[2605]: INFO: ::ffff:127.0.0.1:54492 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1689gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1690gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1691gitlab # [ 197.991857] nixbot[2605]: INFO: ::ffff:127.0.0.1:54500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1692gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1693gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1694gitlab # [ 199.031062] nixbot[2605]: INFO: ::ffff:127.0.0.1:54512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1695gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1696gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1697gitlab # [ 200.068756] nixbot[2605]: INFO: ::ffff:127.0.0.1:54518 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1698gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1699gitlab # [ 201.042147] nix-daemon[2833]: accepted connection from pid 2860, user nixbot1700gitlab # [ 201.056600] nix-daemon[2833]: accepted connection from pid 2828, user nixbot1701gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1702gitlab # [ 201.103779] nixbot[2605]: INFO: ::ffff:127.0.0.1:54520 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1703gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1704gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1705gitlab # [ 202.140459] nixbot[2605]: INFO: ::ffff:127.0.0.1:54528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1706gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1707gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1708gitlab # [ 203.180085] nixbot[2605]: INFO: ::ffff:127.0.0.1:47234 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1709gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1710gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1711gitlab # [ 204.217792] nixbot[2605]: INFO: ::ffff:127.0.0.1:47236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1712gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1713gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1714gitlab # [ 205.256986] nixbot[2605]: INFO: ::ffff:127.0.0.1:47240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1715gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1716gitlab # [ 205.551498] nix-daemon[2833]: accepted connection from pid 2828, user nixbot1717gitlab # [ 205.665046] nix-daemon[2833]: accepted connection from pid 2892, user nixbot1718gitlab # [ 205.689067] gitaly[900]: time="2026-09-04T06:43:51.992Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHKZY0P0G3QTN6DBJKSP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:44:21.291" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:43:51.991" grpc.time_ms=0.809 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1719gitlab # [ 205.847312] gitaly[900]: time="2026-09-04T06:43:52.151Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHKZY0P0G3QTN6DBJKSP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:02.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:43:52.142" grpc.time_ms=8.946 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720gitlab # [ 205.975527] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3441721gitlab # [ 205.977204] nixbot[2605]: {"ts": "2026-09-04T06:43:52.281Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 \"HTTP/1.1 201 Created\""}1722gitlab # [ 206.049331] gitaly[900]: time="2026-09-04T06:43:52.353Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHMB3SD30C4J5C1JSEP5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:44:22.051" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:43:52.352" grpc.time_ms=1.106 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1723gitlab # [ 206.124860] gitaly[900]: time="2026-09-04T06:43:52.428Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHMB3SD30C4J5C1JSEP5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:02.267" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:43:52.417" grpc.time_ms=10.947 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1724gitlab # [ 206.192423] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2041725gitlab # [ 206.198346] nixbot[2605]: {"ts": "2026-09-04T06:43:52.497Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 \"HTTP/1.1 201 Created\""}1726gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1727gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1728gitlab # [ 206.298768] nixbot[2605]: INFO: ::ffff:127.0.0.1:47256 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1729gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1730gitlab # [ 207.333969] nixbot[2605]: INFO: ::ffff:127.0.0.1:47270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1731gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1732gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1733gitlab # [ 208.369879] nixbot[2605]: INFO: ::ffff:127.0.0.1:47280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1734gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1735gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1736gitlab # [ 209.405605] nixbot[2605]: INFO: ::ffff:127.0.0.1:47294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1737gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1738gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1739gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1740gitlab # [ 210.442374] nixbot[2605]: INFO: ::ffff:127.0.0.1:47300 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1741gitlab # [ 210.946032] nix-daemon[2833]: accepted connection from pid 2934, user nixbot1742gitlab # [ 211.006270] gitaly[900]: time="2026-09-04T06:43:57.310Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHS6R9CENXRRKV2523CMD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:44:27.208" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:43:57.309" grpc.time_ms=0.827 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 211.080769] gitaly[900]: time="2026-09-04T06:43:57.384Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHS6R9CENXRRKV2523CMD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:07.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:43:57.373" grpc.time_ms=11.369 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 211.123797] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1541745gitlab # [ 211.130701] nixbot[2605]: {"ts": "2026-09-04T06:43:57.434Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 \"HTTP/1.1 201 Created\""}1746gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1747gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1748gitlab # [ 211.463139] gitaly[900]: time="2026-09-04T06:43:57.767Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHSM1DGAKG3VP0SPEFD0V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:57.755" grpc.time_ms=11.403 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1749gitlab # [ 211.465178] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 701750gitlab # [ 211.472527] nixbot[2605]: INFO: ::ffff:127.0.0.1:47306 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1751gitlab # [ 211.575961] gitaly[900]: time="2026-09-04T06:43:57.880Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHSQCXB63NKEP56ASXMEZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:57.867" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1752gitlab # [ 211.599072] gitaly[900]: time="2026-09-04T06:43:57.880Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHSQCXB63NKEP56ASXMEZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:57.867" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1753gitlab # [ 211.623230] gitlab-workhorse[826]: time="2026-09-04T06:43:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671754gitlab # [ 211.625770] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 761755gitlab # [ 211.627560] gitaly[900]: time="2026-09-04T06:43:57.881Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHSQCXB63NKEP56ASXMEZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:57.867" grpc.time_ms=13.579 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1756gitlab # [ 211.654239] gitaly[900]: time="2026-09-04T06:43:57.958Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHSTFRHP7SRJN09MFCME7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:57.948" pid=900 remote_ip="2001:db8:1::1" request_sha=33c4e35cf84727bb97dff1021a8ec0acd0024c66 response_bytes=337 span.kind=server system=grpc1757gitlab # [ 211.663524] gitaly[900]: time="2026-09-04T06:43:57.958Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHSTFRHP7SRJN09MFCME7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:57.948" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1758gitlab # [ 211.675711] gitlab-workhorse[826]: time="2026-09-04T06:43:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371759gitlab # [ 211.677903] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 551760gitlab # [ 211.678862] gitaly[900]: time="2026-09-04T06:43:57.959Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHSTFRHP7SRJN09MFCME7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:57.948" grpc.time_ms=10.656 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1761gitlab # [ 211.752836] gitaly[900]: time="2026-09-04T06:43:58.057Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHSY0SQN9FC40Z3ZKF611 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:58.050" grpc.time_ms=6.523 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1762gitlab # [ 211.764631] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 521763gitlab # [ 211.809084] gitaly[900]: time="2026-09-04T06:43:58.113Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHSZQKR9WDFKD6B043Q2X grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:58.107" pid=900 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1764gitlab # [ 211.810202] gitaly[900]: time="2026-09-04T06:43:58.113Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHSZQKR9WDFKD6B043Q2X grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:58.107" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1765gitlab # [ 211.810868] gitlab-workhorse[826]: time="2026-09-04T06:43:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671766gitlab # [ 211.811520] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 421767gitlab # [ 211.812199] gitaly[900]: time="2026-09-04T06:43:58.113Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHSZQKR9WDFKD6B043Q2X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:58.107" grpc.time_ms=6.474 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1768gitlab # [ 211.907285] gitaly[900]: time="2026-09-04T06:43:58.211Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHT2WPAZAS9TFEVEAAKNN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:58.201" grpc.time_ms=9.505 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1769gitlab # [ 211.919521] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511770gitlab # [ 212.037718] gitaly[900]: time="2026-09-04T06:43:58.341Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHT4HDPV0VGK1WFZZMX7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:58.323" pid=900 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1771gitlab # [ 212.038614] gitaly[900]: time="2026-09-04T06:43:58.341Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHT4HDPV0VGK1WFZZMX7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:58.323" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1772gitlab # [ 212.040345] gitaly[900]: time="2026-09-04T06:43:58.342Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHT4HDPV0VGK1WFZZMX7D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:43:58.323" grpc.time_ms=18.247 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1773gitlab # [ 212.041036] gitlab-workhorse[826]: time="2026-09-04T06:43:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161774gitlab # [ 212.041779] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:43:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1181775gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1776gitlab # [ 212.511421] nixbot[2605]: INFO: ::ffff:127.0.0.1:47316 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1777gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1778gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1779gitlab # [ 213.548663] nixbot[2605]: INFO: ::ffff:127.0.0.1:59260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1780gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1781gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1782gitlab # [ 214.585320] nixbot[2605]: INFO: ::ffff:127.0.0.1:59270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1783gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1784gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1785gitlab # [ 215.622328] nixbot[2605]: INFO: ::ffff:127.0.0.1:59276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1786gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1787gitlab # [ 215.847784] sidekiq-cluster[2557]: 2026-09-04T06:44:02.151Z pid=2557 tid=xud INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2557, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431915008}1788gitlab # [ 216.015853] sidekiq-cluster[2557]: W, [2026-09-04T06:44:02.319967 #2557] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1789gitlab # [ 216.052832] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:02.356Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1790gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1791gitlab # [ 216.660883] nixbot[2605]: INFO: ::ffff:127.0.0.1:59290 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1792gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1793gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1794gitlab # [ 217.699539] nixbot[2605]: INFO: ::ffff:127.0.0.1:59298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1795gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1796gitlab # [ 217.724125] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:04.027Z","message":"GitLab reliable fetch activated!"}1797gitlab # [ 217.727776] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:04.027Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1798gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1799gitlab # [ 218.736131] nixbot[2605]: INFO: ::ffff:127.0.0.1:59310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1800gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1801gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1802gitlab # [ 219.773260] nixbot[2605]: INFO: ::ffff:127.0.0.1:59320 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1803gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1804gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1805gitlab # [ 220.809696] nixbot[2605]: INFO: ::ffff:127.0.0.1:59326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1806gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1807gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1808gitlab # [ 221.837923] nixbot[2605]: INFO: ::ffff:127.0.0.1:59340 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1809gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.02 seconds)1810gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1811gitlab # [ 222.859073] nixbot[2605]: INFO: ::ffff:127.0.0.1:59346 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1812gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.02 seconds)1813gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1814gitlab # [ 223.891671] nixbot[2605]: INFO: ::ffff:127.0.0.1:58142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1815gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1816gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1817gitlab # [ 224.929148] nixbot[2605]: INFO: ::ffff:127.0.0.1:58144 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1818gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1819gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1820gitlab # [ 225.951582] nixbot[2605]: INFO: ::ffff:127.0.0.1:58152 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1821gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.02 seconds)1822gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1823gitlab # [ 226.986418] nixbot[2605]: INFO: ::ffff:127.0.0.1:58162 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1824gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1825gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1826gitlab # [ 228.023245] nixbot[2605]: INFO: ::ffff:127.0.0.1:58168 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1827gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1828gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1829gitlab # [ 229.060506] nixbot[2605]: INFO: ::ffff:127.0.0.1:58174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1830gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1831gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1832gitlab # [ 230.102435] nixbot[2605]: INFO: ::ffff:127.0.0.1:58184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1833gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1834gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1835gitlab # [ 231.148360] nixbot[2605]: INFO: ::ffff:127.0.0.1:58188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1836gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.05 seconds)1837gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1838gitlab # [ 232.188653] nixbot[2605]: INFO: ::ffff:127.0.0.1:58200 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1839gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1840gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1841gitlab # [ 233.225491] nixbot[2605]: INFO: ::ffff:127.0.0.1:60974 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1842gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1843gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1844gitlab # [ 234.269213] nixbot[2605]: INFO: ::ffff:127.0.0.1:60988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1845gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.05 seconds)1846gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1847gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1848gitlab # [ 235.312223] nixbot[2605]: INFO: ::ffff:127.0.0.1:60996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1849gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1850gitlab # [ 236.346722] nixbot[2605]: INFO: ::ffff:127.0.0.1:32768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1852gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1853gitlab # [ 237.385991] nixbot[2605]: INFO: ::ffff:127.0.0.1:32784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1854gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1855gitlab # [ 237.608345] postgres[3127]: [3127] ERROR: relation "table_without_models" does not exist1856gitlab # [ 237.611065] postgres[3127]: [3127] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1857gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1858gitlab # [ 238.431613] nixbot[2605]: INFO: ::ffff:127.0.0.1:32788 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1859gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1860gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1861gitlab # [ 239.468147] nixbot[2605]: INFO: ::ffff:127.0.0.1:32796 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1862gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1863gitlab # [ 240.068144] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:26.371Z","message":"Booted Rails 7.2.3.1 application in production environment"}1864gitlab # [ 240.070430] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:26.374Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1865gitlab # [ 240.072280] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:26.374Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1866gitlab # [ 240.074060] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:26.374Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1867gitlab # [ 240.075972] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:26.378Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1868gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1869gitlab # [ 240.502632] nixbot[2605]: INFO: ::ffff:127.0.0.1:32800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.04 seconds)1871gitlab # [ 241.368588] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:27.671Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bf728029a874f06546d7a7af","created_at":"2026-09-04T06:43:35.613Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:35.641Z","job_size_bytes":2,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bf728029a874f06546d7a7af: start","job_status":"start","queue_duration_s":52.03053,"scheduling_latency_s":52.030566}1872gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1874gitlab # [ 241.537876] nixbot[2605]: INFO: ::ffff:127.0.0.1:32804 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1875gitlab # [ 241.557876] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:27.861Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bf728029a874f06546d7a7af","created_at":"2026-09-04T06:43:35.613Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:35.641Z","job_size_bytes":2,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bf728029a874f06546d7a7af: done: 0.18961 sec","job_status":"done","queue_duration_s":52.03053,"scheduling_latency_s":52.030566,"redis_calls":25,"redis_duration_s":0.0065379999999999995,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003433,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001656,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11113256,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.18961,"completed_at":"2026-09-04T06:44:27.861Z","load_balancing_strategy":"primary","db_duration_s":0.060749,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1876gitlab # [ 241.626121] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:27.863Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e40085bfd920e21633adf43d","created_at":"2026-09-04T06:43:35.649Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:35.653Z","job_size_bytes":2,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e40085bfd920e21633adf43d: start","job_status":"start","queue_duration_s":52.210401,"scheduling_latency_s":52.210433}1877gitlab # [ 241.667312] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:27.970Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e40085bfd920e21633adf43d","created_at":"2026-09-04T06:43:35.649Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:35.653Z","job_size_bytes":2,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e40085bfd920e21633adf43d: done: 0.10732 sec","job_status":"done","queue_duration_s":52.210401,"scheduling_latency_s":52.210433,"redis_calls":14,"redis_duration_s":0.004223,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002153,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001315,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.078727044,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.10732,"completed_at":"2026-09-04T06:44:27.970Z","load_balancing_strategy":"primary","db_duration_s":0.029149,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1878gitlab # [ 241.708888] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:28.012Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"22eeabd6adc059a9eacab89a","created_at":"2026-09-04T06:43:36.039Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:36.044Z","job_size_bytes":5,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-22eeabd6adc059a9eacab89a: start","job_status":"start","queue_duration_s":51.968237,"scheduling_latency_s":51.968277}1879gitlab # [ 241.867496] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:28.171Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"22eeabd6adc059a9eacab89a","created_at":"2026-09-04T06:43:36.039Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:36.044Z","job_size_bytes":5,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-22eeabd6adc059a9eacab89a: done: 0.158947 sec","job_status":"done","queue_duration_s":51.968237,"scheduling_latency_s":51.968277,"redis_calls":12,"redis_duration_s":0.002853,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000692,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001725,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000280483,"duration_s":0.158947,"completed_at":"2026-09-04T06:44:28.171Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025937,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1880gitlab # [ 241.945188] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:28.249Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"00bb31556c425c9c08b3e782","created_at":"2026-09-04T06:43:36.064Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:36.072Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-00bb31556c425c9c08b3e782: start","job_status":"start","queue_duration_s":52.176449,"scheduling_latency_s":52.176479}1881gitlab # [ 242.129533] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:28.433Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"00bb31556c425c9c08b3e782","created_at":"2026-09-04T06:43:36.064Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:36.072Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-00bb31556c425c9c08b3e782: done: 0.184393 sec","job_status":"done","queue_duration_s":52.176449,"scheduling_latency_s":52.176479,"redis_calls":11,"redis_duration_s":0.002087,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000399,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.137,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.137,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.10105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286349,"duration_s":0.184393,"completed_at":"2026-09-04T06:44:28.433Z","load_balancing_strategy":"primary","db_duration_s":0.07022,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1882gitlab # [ 242.207269] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:28.511Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"1ea8a57995e146ac6dda18e1","created_at":"2026-09-04T06:43:36.077Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:36.083Z","job_size_bytes":89,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-1ea8a57995e146ac6dda18e1: start","job_status":"start","queue_duration_s":52.427007,"scheduling_latency_s":52.427035}1883gitlab # [ 242.255514] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:28.559Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"1ea8a57995e146ac6dda18e1","created_at":"2026-09-04T06:43:36.077Z","trace_propagation_headers":{"sentry-trace":"5f64e5101afa4fcab204d085e5b8cbeb-c3b8795c96f44800","baggage":"sentry-trace_id=5f64e5101afa4fcab204d085e5b8cbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH2XHN6PH7VDT60YW05NV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:36.083Z","job_size_bytes":89,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-1ea8a57995e146ac6dda18e1: done: 0.048152 sec","job_status":"done","queue_duration_s":52.427007,"scheduling_latency_s":52.427035,"redis_calls":11,"redis_duration_s":0.0034029999999999998,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000998,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000507048,"duration_s":0.048152,"completed_at":"2026-09-04T06:44:28.559Z","load_balancing_strategy":"primary","db_duration_s":0.00643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1884gitlab # [ 242.257322] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:28.561Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e441c531bcadf2c8ccc5f608d9337067130f1e75 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c4a8392ba3a86662b26915ad","created_at":"2026-09-04T06:43:37.637Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-d0d179450cca4fdc","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:37.657Z","job_size_bytes":185,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c4a8392ba3a86662b26915ad: start","job_status":"start","queue_duration_s":50.903902,"scheduling_latency_s":50.903927}1885gitlab # [ 242.308905] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:28.574Z","message":"changes: \"0000000000000000000000000000000000000000 e441c531bcadf2c8ccc5f608d9337067130f1e75 refs/heads/master\\n\""}1886gitlab # [ 242.310339] gitaly[900]: time="2026-09-04T06:44:28.602Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:38.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:28.594" grpc.time_ms=6.873 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887gitlab # [ 242.311293] gitaly[900]: time="2026-09-04T06:44:28.611Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:44:38.015" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:28.605" grpc.time_ms=5.369 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888gitlab # [ 242.348816] gitaly[900]: time="2026-09-04T06:44:28.653Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T06:44:38.052" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:28.643" grpc.time_ms=9.84 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889gitlab # [ 242.382524] gitaly[900]: time="2026-09-04T06:44:28.686Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:28.686" grpc.time_ms=0.245 pid=900 span.kind=server system=grpc1890gitlab # [ 242.419498] gitaly[900]: time="2026-09-04T06:44:28.723Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:28.723" grpc.time_ms=0.371 pid=900 span.kind=server system=grpc1891gitlab # [ 242.439080] gitaly[900]: time="2026-09-04T06:44:28.743Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 diskcache=14f971e6-0e68-448f-9acf-cda0557324ac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:44:38.069" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:28.660" pid=900 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1892gitlab # [ 242.448985] gitaly[900]: time="2026-09-04T06:44:28.743Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=73 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4942 command.oublock=8 command.real_time_ms=74 command.spawn_token_fork_ms=0 command.system_time_ms=47 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:44:38.069" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:28.660" grpc.time_ms=83.368 pid=900 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1893gitlab # [ 242.460757] gitaly[900]: time="2026-09-04T06:44:28.764Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:44:38.174" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:28.764" grpc.time_ms=0.109 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894gitlab # [ 242.480365] gitaly[900]: time="2026-09-04T06:44:28.784Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=940 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T06:44:38.179" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:28.769" grpc.time_ms=14.761 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1896gitlab # [ 242.545284] gitaly[900]: time="2026-09-04T06:44:28.849Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-04T06:44:58.041" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:28.842" grpc.time_ms=7.437 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1897gitlab # [ 242.569478] nixbot[2605]: INFO: ::ffff:127.0.0.1:32814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1898gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1899gitlab # [ 242.606916] gitaly[900]: time="2026-09-04T06:44:28.911Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T06:44:38.009" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:28.910" grpc.time_ms=0.555 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1900gitlab # [ 242.629444] gitaly[900]: time="2026-09-04T06:44:28.921Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T06:44:38.013" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T06:44:28.914" grpc.time_ms=7.048 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1901gitlab # [ 242.648640] gitaly[900]: time="2026-09-04T06:44:28.949Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:38.038" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:28.938" grpc.time_ms=10.909 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1902gitlab # [ 242.673576] gitaly[900]: time="2026-09-04T06:44:28.977Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:38.067" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:28.968" grpc.time_ms=9.445 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1903gitlab # [ 242.711658] gitaly[900]: time="2026-09-04T06:44:29.015Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T06:44:58.198" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:28.998" grpc.time_ms=17.015 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1904gitlab # [ 243.127861] gitaly[900]: time="2026-09-04T06:44:29.432Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T06:44:39.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:29.430" grpc.time_ms=1.278 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab # [ 243.176246] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:29.478Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e441c531bcadf2c8ccc5f608d9337067130f1e75 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c4a8392ba3a86662b26915ad","created_at":"2026-09-04T06:43:37.637Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-d0d179450cca4fdc","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:37.657Z","job_size_bytes":185,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c4a8392ba3a86662b26915ad: done: 0.917648 sec","job_status":"done","queue_duration_s":50.903902,"scheduling_latency_s":50.903927,"gitaly_calls":13,"gitaly_duration_s":0.269211,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.057829,"redis_read_bytes":2103,"redis_write_bytes":21748,"redis_cache_calls":15,"redis_cache_duration_s":0.004593,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006531,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001626,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003131,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.029831,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.012117,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.19,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.21,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.532125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00042715,"exclusive_lock_hold_duration_s":0.021167775,"duration_s":0.917648,"completed_at":"2026-09-04T06:44:29.478Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087859,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1906gitlab # [ 243.183632] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:29.481Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e441c531bcadf2c8ccc5f608d9337067130f1e75 5802e58b9ea85d54624c49ab9ff40b06d35bfcee refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"641ac6a1e782ca0e1270467a","created_at":"2026-09-04T06:43:42.037Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-e3fe8bc3ca8a4cd1","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:42.039Z","job_size_bytes":185,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-641ac6a1e782ca0e1270467a: start","job_status":"start","queue_duration_s":47.442507,"scheduling_latency_s":47.442541}1907gitlab # [ 243.236133] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:29.499Z","message":"changes: \"e441c531bcadf2c8ccc5f608d9337067130f1e75 5802e58b9ea85d54624c49ab9ff40b06d35bfcee refs/heads/master\\n\""}1908gitlab # [ 243.236937] gitaly[900]: time="2026-09-04T06:44:29.538Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:39.105" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:29.525" grpc.time_ms=12.23 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab # [ 243.273563] gitaly[900]: time="2026-09-04T06:44:29.577Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:44:39.148" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:29.568" grpc.time_ms=8.668 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 243.281068] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:29.584Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"e0f348e1f313515fab7081bf","created_at":"2026-09-04T06:44:29.581Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-3eef81a9af34458b","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"b1591ae370f93ffe3a2677d4","job_size_bytes":46,"pid":2557,"job_status":"deduplicated","message":"ProjectCacheWorker JID-e0f348e1f313515fab7081bf: deduplicated: until executing","deduplication.type":"until executing"}1911gitlab # [ 243.308249] gitaly[900]: time="2026-09-04T06:44:29.612Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T06:44:39.011" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:29.601" grpc.time_ms=10.588 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912gitlab # [ 243.331383] gitaly[900]: time="2026-09-04T06:44:29.634Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-04T06:44:59.025" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:29.625" grpc.time_ms=9.271 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1913gitlab # [ 243.368980] gitaly[900]: time="2026-09-04T06:44:29.673Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T06:44:39.075" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T06:44:29.665" grpc.time_ms=7.338 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1914gitlab # [ 243.390589] gitaly[900]: time="2026-09-04T06:44:29.694Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:39.094" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:29.684" grpc.time_ms=9.504 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915gitlab # [ 243.481333] gitaly[900]: time="2026-09-04T06:44:29.785Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T06:44:39.193" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:29.783" grpc.time_ms=1.507 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916gitlab # [ 243.510542] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:29.813Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e441c531bcadf2c8ccc5f608d9337067130f1e75 5802e58b9ea85d54624c49ab9ff40b06d35bfcee refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"641ac6a1e782ca0e1270467a","created_at":"2026-09-04T06:43:42.037Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-e3fe8bc3ca8a4cd1","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:43:42.039Z","job_size_bytes":185,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-641ac6a1e782ca0e1270467a: done: 0.332098 sec","job_status":"done","queue_duration_s":47.442507,"scheduling_latency_s":47.442541,"gitaly_calls":7,"gitaly_duration_s":0.127235,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.028473,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.002969,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001183,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004715,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010632,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.008974,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.03,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.03,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000730819,"exclusive_lock_hold_duration_s":0.054014407,"duration_s":0.332098,"completed_at":"2026-09-04T06:44:29.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027603,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1917gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1918gitlab # [ 243.520365] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:29.816Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"43f266eaa64aa21db62e4593","created_at":"2026-09-04T06:43:42.224Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-8ea6881a6b734a04","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:42.229Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-43f266eaa64aa21db62e4593: start","job_status":"start","queue_duration_s":47.587112,"scheduling_latency_s":47.587147}1919gitlab # [ 243.600355] nixbot[2605]: INFO: ::ffff:127.0.0.1:39068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1920gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1921gitlab # [ 243.666955] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:29.970Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"43f266eaa64aa21db62e4593","created_at":"2026-09-04T06:43:42.224Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-8ea6881a6b734a04","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:42.229Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-43f266eaa64aa21db62e4593: done: 0.154528 sec","job_status":"done","queue_duration_s":47.587112,"scheduling_latency_s":47.587147,"redis_calls":16,"redis_duration_s":0.004705,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002604,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001539,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.124332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000478273,"duration_s":0.154528,"completed_at":"2026-09-04T06:44:29.970Z","load_balancing_strategy":"primary","db_duration_s":0.019194,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1922gitlab # [ 243.668603] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:29.972Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"27c73f9c39d762ad026c3f7e","created_at":"2026-09-04T06:43:42.229Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-8ea6881a6b734a04","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:42.232Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-27c73f9c39d762ad026c3f7e: start","job_status":"start","queue_duration_s":47.740119,"scheduling_latency_s":47.740137}1923gitlab # [ 243.870076] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.173Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"27c73f9c39d762ad026c3f7e","created_at":"2026-09-04T06:43:42.229Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-8ea6881a6b734a04","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:42.232Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-27c73f9c39d762ad026c3f7e: done: 0.201312 sec","job_status":"done","queue_duration_s":47.740119,"scheduling_latency_s":47.740137,"redis_calls":21,"redis_duration_s":0.00687,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003397,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001881,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.101,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.094,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065986,"duration_s":0.201312,"completed_at":"2026-09-04T06:44:30.173Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.106533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1924gitlab # [ 243.873458] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.176Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7871889844118ab7ada91a94","created_at":"2026-09-04T06:43:42.303Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-8ea6881a6b734a04","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:42.307Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7871889844118ab7ada91a94: start","job_status":"start","queue_duration_s":47.868738,"scheduling_latency_s":47.86877}1925gitlab # [ 244.095249] gitaly[900]: time="2026-09-04T06:44:30.399Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:30.398" grpc.time_ms=0.98 pid=900 span.kind=server system=grpc1926gitlab # [ 244.152545] gitaly[900]: time="2026-09-04T06:44:30.456Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:30.455" grpc.time_ms=0.592 pid=900 span.kind=server system=grpc1927gitlab # [ 244.214707] gitaly[900]: time="2026-09-04T06:44:30.518Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:30.517" grpc.time_ms=0.719 pid=900 span.kind=server system=grpc1928gitlab # [ 244.242830] gitaly[900]: time="2026-09-04T06:44:30.547Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW diskcache=853b0a7c-9e28-4336-8f33-f3e869740d61 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:00.058" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:30.359" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1929gitlab # [ 244.244200] gitaly[900]: time="2026-09-04T06:44:30.547Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=189 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7367 command.oublock=0 command.real_time_ms=180 command.spawn_token_fork_ms=0 command.system_time_ms=121 command.user_time_ms=68 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:00.058" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:30.359" grpc.time_ms=187.645 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930gitlab # [ 244.385712] gitaly[900]: time="2026-09-04T06:44:30.689Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:45:00.387" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:30.687" grpc.time_ms=1.251 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 244.431263] gitaly[900]: time="2026-09-04T06:44:30.735Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:00.433" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:30.733" grpc.time_ms=1.146 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 244.459135] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.750Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7871889844118ab7ada91a94","created_at":"2026-09-04T06:43:42.303Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-8ea6881a6b734a04","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:42.307Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2557,"job_status":"rescheduled","message":"PipelineProcessWorker JID-7871889844118ab7ada91a94: rescheduled"}1933gitlab # [ 244.461065] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.760Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7871889844118ab7ada91a94","created_at":"2026-09-04T06:43:42.303Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-8ea6881a6b734a04","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:43:42.307Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7871889844118ab7ada91a94: done: 0.584683 sec","job_status":"done","queue_duration_s":47.868738,"scheduling_latency_s":47.86877,"gitaly_calls":3,"gitaly_duration_s":0.223658,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.030307999999999998,"redis_read_bytes":462,"redis_write_bytes":29288,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001411,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001883,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010741,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.00452,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15575,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006553,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000529,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000579,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002681,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.131,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.017,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.102,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.196272,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.449133899,"duration_s":0.584683,"completed_at":"2026-09-04T06:44:30.760Z","load_balancing_strategy":"primary","db_duration_s":0.143724,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1934gitlab # [ 244.512965] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.762Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b1591ae370f93ffe3a2677d4","created_at":"2026-09-04T06:44:28.612Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:28.625Z","job_size_bytes":46,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b1591ae370f93ffe3a2677d4: start","job_status":"start","queue_duration_s":2.137341,"scheduling_latency_s":2.13738}1935gitlab # [ 244.514075] gitaly[900]: time="2026-09-04T06:44:30.799Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-04T12:44:30.793" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:30.794" grpc.time_ms=4.829 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936gitlab # [ 244.517253] gitaly[900]: time="2026-09-04T06:44:30.821Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T06:45:00.512" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:30.812" grpc.time_ms=8.422 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1938gitlab # [ 244.560154] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.858Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b1591ae370f93ffe3a2677d4","created_at":"2026-09-04T06:44:28.612Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:28.625Z","job_size_bytes":46,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b1591ae370f93ffe3a2677d4: done: 0.095729 sec","job_status":"done","queue_duration_s":2.137341,"scheduling_latency_s":2.13738,"gitaly_calls":2,"gitaly_duration_s":0.019156,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008074,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001691,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000811,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001678,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003186,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000294451,"duration_s":0.095729,"completed_at":"2026-09-04T06:44:30.858Z","load_balancing_strategy":"primary","db_duration_s":0.014698,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1939gitlab # [ 244.569850] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.859Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f16cfa80b6a53075ca93a65e","created_at":"2026-09-04T06:44:28.637Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:28.640Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f16cfa80b6a53075ca93a65e: start","job_status":"start","queue_duration_s":2.219625,"scheduling_latency_s":2.21964}1940gitlab # [ 244.601575] gitaly[900]: time="2026-09-04T06:44:30.905Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 diskcache=15965c33-125d-4f10-82ed-8e62508d6156 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T12:44:30.877" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:30.878" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 244.602608] gitaly[900]: time="2026-09-04T06:44:30.906Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1288 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T12:44:30.877" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:30.878" grpc.time_ms=27.916 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1942gitlab # [ 244.635335] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.939Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f16cfa80b6a53075ca93a65e","created_at":"2026-09-04T06:44:28.637Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:28.640Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f16cfa80b6a53075ca93a65e: done: 0.079529 sec","job_status":"done","queue_duration_s":2.219625,"scheduling_latency_s":2.21964,"gitaly_calls":1,"gitaly_duration_s":0.03078,"redis_calls":15,"redis_duration_s":0.003221,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000651,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060716376999999995,"duration_s":0.079529,"completed_at":"2026-09-04T06:44:30.939Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1943gitlab # [ 244.682887] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.940Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"4f7db4e4ce6f4046580d18bd","created_at":"2026-09-04T06:44:28.760Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:28.762Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-4f7db4e4ce6f4046580d18bd: start","job_status":"start","queue_duration_s":2.178775,"scheduling_latency_s":2.178812}1944gitlab # [ 244.683578] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.985Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"4f7db4e4ce6f4046580d18bd","created_at":"2026-09-04T06:44:28.760Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:28.762Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-4f7db4e4ce6f4046580d18bd: done: 0.04429 sec","job_status":"done","queue_duration_s":2.178775,"scheduling_latency_s":2.178812,"gitaly_calls":1,"gitaly_duration_s":0.010251,"redis_calls":16,"redis_duration_s":0.003173,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000202,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001563,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04429,"completed_at":"2026-09-04T06:44:30.985Z","load_balancing_strategy":"primary","db_duration_s":0.003225,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1945gitlab # [ 244.704564] gitaly[900]: time="2026-09-04T06:44:30.977Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T06:45:00.668" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:30.969" grpc.time_ms=7.626 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946gitlab # [ 244.716361] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:30.986Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"28d8f2ff4940723993cbdafc","created_at":"2026-09-04T06:44:29.286Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b05f7a17afe7e3fb68eccca99b975617e8d30097c29f76989a882c45baed3fd4","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.294Z","job_size_bytes":467,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-28d8f2ff4940723993cbdafc: start","job_status":"start","queue_duration_s":1.692221,"scheduling_latency_s":1.692273}1947gitlab # [ 244.732048] gitaly[900]: time="2026-09-04T06:44:31.012Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:01.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.011" grpc.time_ms=0.733 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 244.743206] gitaly[900]: time="2026-09-04T06:44:31.018Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T06:44:41.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:31.013" grpc.time_ms=5.434 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 244.786067] gitaly[900]: time="2026-09-04T06:44:31.086Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:45:01.085" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.085" grpc.time_ms=0.565 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.21 seconds)1951gitlab # [ 244.787513] gitaly[900]: time="2026-09-04T06:44:31.091Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=131 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T06:45:01.088" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.088" grpc.time_ms=3.138 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab # [ 244.814663] nixbot[2605]: INFO: ::ffff:127.0.0.1:39074 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1953gitlab # [ 244.844397] gitaly[900]: time="2026-09-04T06:44:31.148Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:41.132" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:31.142" grpc.time_ms=5.596 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954gitlab # [ 245.262924] gitaly[900]: time="2026-09-04T06:44:31.567Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T06:45:01.248" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.549" grpc.time_ms=17.662 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 245.281673] gitaly[900]: time="2026-09-04T06:44:31.585Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH5DR85A82QE4WM7816B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T06:45:01.270" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.571" grpc.time_ms=14.562 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 245.320446] sidekiq-cluster[2557]: {"severity":"WARN","time":"2026-09-04T06:44:31.624Z","class":"CreatePipelineWorker","correlation_id":"01M1NJH5DR85A82QE4WM7816B4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"e441c531bcadf2c8ccc5f608d9337067130f1e75","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e441c531bcadf2c8ccc5f608d9337067130f1e75","ref":"refs/heads/master"},"retry":0}1957gitlab # [ 245.330158] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:31.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"28d8f2ff4940723993cbdafc","created_at":"2026-09-04T06:44:29.286Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b05f7a17afe7e3fb68eccca99b975617e8d30097c29f76989a882c45baed3fd4","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.294Z","job_size_bytes":467,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-28d8f2ff4940723993cbdafc: done: 0.64721 sec","job_status":"done","queue_duration_s":1.692221,"scheduling_latency_s":1.692273,"gitaly_calls":7,"gitaly_duration_s":0.062161,"redis_calls":51,"redis_duration_s":0.00727,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000524,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003076,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001673,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.537163,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000365689,"duration_s":0.64721,"completed_at":"2026-09-04T06:44:31.633Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035406,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1958gitlab # [ 245.337266] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:31.635Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f2f7cfb4-d576-4b7f-ac9d-2ee55c8914e3\"}"],"class":"WebHookWorker","jid":"7e8cfbbe233a025df63e808d","created_at":"2026-09-04T06:44:29.407Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca90ab33c1d3c58f8a320eb50dac4ab82a36011d394dffa64cb497fd1f9e0e4a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.411Z","job_size_bytes":1751,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7e8cfbbe233a025df63e808d: start","job_status":"start","queue_duration_s":2.22404,"scheduling_latency_s":2.22408}1959gitlab # [ 245.437691] nixbot[2605]: INFO: ::ffff:127.0.0.1:39078 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1960gitlab # [ 245.456469] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:31.760Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f2f7cfb4-d576-4b7f-ac9d-2ee55c8914e3\"}"],"class":"WebHookWorker","jid":"7e8cfbbe233a025df63e808d","created_at":"2026-09-04T06:44:29.407Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-bc294321d53d4c50","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca90ab33c1d3c58f8a320eb50dac4ab82a36011d394dffa64cb497fd1f9e0e4a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.411Z","job_size_bytes":1751,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7e8cfbbe233a025df63e808d: done: 0.12432 sec","job_status":"done","queue_duration_s":2.22404,"scheduling_latency_s":2.22408,"redis_calls":19,"redis_duration_s":0.00392,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000865,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000298,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000785,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.046163688999996566,"cpu_s":0.062622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000988673,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.12432,"completed_at":"2026-09-04T06:44:31.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1961gitlab # [ 245.515288] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:31.818Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a44ddcb17afc17e88e33b37c","created_at":"2026-09-04T06:44:29.592Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-3eef81a9af34458b","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"f16cfa80b6a53075ca93a65e","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.595Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a44ddcb17afc17e88e33b37c: start","job_status":"start","queue_duration_s":2.223177,"scheduling_latency_s":2.223222}1962gitlab # [ 245.551766] gitaly[900]: time="2026-09-04T06:44:31.855Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY diskcache=b35aaf57-0b9e-4af7-a9e8-c37ff4e69a57 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T12:44:31.844" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.845" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab # [ 245.552866] gitaly[900]: time="2026-09-04T06:44:31.855Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T12:44:31.844" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.845" grpc.time_ms=10.353 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1964gitlab # [ 245.564362] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:31.868Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a44ddcb17afc17e88e33b37c","created_at":"2026-09-04T06:44:29.592Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-3eef81a9af34458b","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"f16cfa80b6a53075ca93a65e","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.595Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a44ddcb17afc17e88e33b37c: done: 0.049479 sec","job_status":"done","queue_duration_s":2.223177,"scheduling_latency_s":2.223222,"gitaly_calls":1,"gitaly_duration_s":0.012783,"redis_calls":12,"redis_duration_s":0.003311,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000752,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02607147,"duration_s":0.049479,"completed_at":"2026-09-04T06:44:31.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1965gitlab # [ 245.610349] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:31.871Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"87d0c1c116a1792a810a17bd","created_at":"2026-09-04T06:44:29.758Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-3eef81a9af34458b","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e708312c1f2ce98c9744db98621814d7108f5fab17035f57b915fe159ad2038a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.761Z","job_size_bytes":467,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-87d0c1c116a1792a810a17bd: start","job_status":"start","queue_duration_s":2.109779,"scheduling_latency_s":2.109794}1966gitlab # [ 245.611482] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1141967gitlab # [ 245.612135] gitaly[900]: time="2026-09-04T06:44:31.878Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJJTWM2BHG3FJC0285FJX6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:31.866" grpc.time_ms=12.138 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1968gitlab # [ 245.612716] gitaly[900]: time="2026-09-04T06:44:31.897Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:01.596" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.896" grpc.time_ms=0.427 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 245.622665] gitaly[900]: time="2026-09-04T06:44:31.926Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJV09G50N1PCRVX83YVHX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:31.920" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1970gitlab # [ 245.623582] gitaly[900]: time="2026-09-04T06:44:31.927Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJV09G50N1PCRVX83YVHX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:31.920" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1971gitlab # [ 245.672385] gitlab-workhorse[826]: time="2026-09-04T06:44:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671972gitlab # [ 245.673192] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 461973gitlab # [ 245.673620] nixbot[2605]: {"ts": "2026-09-04T06:44:31.945Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1974gitlab # [ 245.674458] gitaly[900]: time="2026-09-04T06:44:31.927Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJV09G50N1PCRVX83YVHX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:31.920" grpc.time_ms=6.554 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc1975gitlab # [ 245.675134] gitaly[900]: time="2026-09-04T06:44:31.958Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T06:44:41.001" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:31.951" grpc.time_ms=6.927 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 245.680713] gitaly[900]: time="2026-09-04T06:44:31.984Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:45:01.683" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.984" grpc.time_ms=0.741 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1977gitlab # [ 245.684728] gitaly[900]: time="2026-09-04T06:44:31.988Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=97 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T06:45:01.686" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:31.986" grpc.time_ms=1.844 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978gitlab # [ 245.728425] gitaly[900]: time="2026-09-04T06:44:32.014Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJV2PVBB3J60TN5QHMZH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:02.013" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:32.014" grpc.time_ms=0.461 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 245.729138] gitaly[900]: time="2026-09-04T06:44:32.019Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:42.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:32.012" grpc.time_ms=6.276 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 245.761867] gitaly[900]: time="2026-09-04T06:44:32.066Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJJV2PVBB3J60TN5QHMZH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:42.049" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:32.060" grpc.time_ms=5.998 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 245.806676] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1521982gitlab # [ 245.809928] nixbot[2605]: {"ts": "2026-09-04T06:44:32.114Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 \"HTTP/1.1 201 Created\""}1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'1984gitlab # [ 245.842152] nixbot[2605]: INFO: ::ffff:127.0.0.1:39082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.03 seconds)1986gitlab # [ 245.861277] gitaly[900]: time="2026-09-04T06:44:32.165Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJV7QMFPNX772P8MPSD3F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:02.064" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:32.164" grpc.time_ms=0.531 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1987gitlab # [ 245.891134] gitaly[900]: time="2026-09-04T06:44:32.195Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJJV7QMFPNX772P8MPSD3F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:42.179" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:32.189" grpc.time_ms=5.764 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 245.934824] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1191989gitlab # [ 245.940193] nixbot[2605]: {"ts": "2026-09-04T06:44:32.244Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 \"HTTP/1.1 201 Created\""}1990gitlab # [ 245.999507] gitaly[900]: time="2026-09-04T06:44:32.303Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVBWG3JBBDZCC0HMXG5R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:02.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:32.300" grpc.time_ms=3.206 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 246.028168] gitaly[900]: time="2026-09-04T06:44:32.332Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T06:45:02.290" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:32.290" grpc.time_ms=41.371 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1992gitlab # [ 246.050694] gitaly[900]: time="2026-09-04T06:44:32.342Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJH9XKCVK6T28VZWZ97CZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T06:45:02.035" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:32.335" grpc.time_ms=7.31 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 246.051555] sidekiq-cluster[2557]: {"severity":"WARN","time":"2026-09-04T06:44:32.351Z","class":"CreatePipelineWorker","correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"e441c531bcadf2c8ccc5f608d9337067130f1e75","after":"5802e58b9ea85d54624c49ab9ff40b06d35bfcee","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"5802e58b9ea85d54624c49ab9ff40b06d35bfcee","ref":"refs/heads/master"},"retry":0}1994gitlab # [ 246.052344] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.354Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"87d0c1c116a1792a810a17bd","created_at":"2026-09-04T06:44:29.758Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-3eef81a9af34458b","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e708312c1f2ce98c9744db98621814d7108f5fab17035f57b915fe159ad2038a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.761Z","job_size_bytes":467,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-87d0c1c116a1792a810a17bd: done: 0.483666 sec","job_status":"done","queue_duration_s":2.109779,"scheduling_latency_s":2.109794,"gitaly_calls":7,"gitaly_duration_s":0.129463,"redis_calls":33,"redis_duration_s":0.004131,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000413,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002084,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000713,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.33495,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.483666,"completed_at":"2026-09-04T06:44:32.354Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018163,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1995gitlab # [ 246.072215] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.355Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"6c6e12a2-a92d-4764-abf1-b1a21b6c0477\"}"],"class":"WebHookWorker","jid":"ef2cef9d12229974b3a08595","created_at":"2026-09-04T06:44:29.772Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-3eef81a9af34458b","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:25bc22f96e6659cdd16a923c8a41689b17acb2f60588374a94e475595f3970d6","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.774Z","job_size_bytes":1749,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ef2cef9d12229974b3a08595: start","job_status":"start","queue_duration_s":2.581751,"scheduling_latency_s":2.581768}1996gitlab # [ 246.087967] nixbot[2605]: INFO: ::ffff:127.0.0.1:39086 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1997gitlab # [ 246.089619] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.381Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"6c6e12a2-a92d-4764-abf1-b1a21b6c0477\"}"],"class":"WebHookWorker","jid":"ef2cef9d12229974b3a08595","created_at":"2026-09-04T06:44:29.772Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-3eef81a9af34458b","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:25bc22f96e6659cdd16a923c8a41689b17acb2f60588374a94e475595f3970d6","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:29.774Z","job_size_bytes":1749,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ef2cef9d12229974b3a08595: done: 0.025258 sec","job_status":"done","queue_duration_s":2.581751,"scheduling_latency_s":2.581768,"redis_calls":14,"redis_duration_s":0.002047,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.0005,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.005097016999997095,"cpu_s":0.014369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.025258,"completed_at":"2026-09-04T06:44:32.381Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1998gitlab # [ 246.133562] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.382Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"058fd37cffbfa32042dae937","created_at":"2026-09-04T06:44:30.347Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.350Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-058fd37cffbfa32042dae937: start","job_status":"start","queue_duration_s":2.031891,"scheduling_latency_s":2.031906}1999gitlab # [ 246.147655] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.436Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"058fd37cffbfa32042dae937","created_at":"2026-09-04T06:44:30.347Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.350Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-058fd37cffbfa32042dae937: done: 0.054418 sec","job_status":"done","queue_duration_s":2.031891,"scheduling_latency_s":2.031906,"redis_calls":10,"redis_duration_s":0.0018380000000000002,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000388876,"duration_s":0.054418,"completed_at":"2026-09-04T06:44:32.436Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013824,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2000gitlab # [ 246.192244] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.438Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a3663ed33f45e7c7a3b24151","created_at":"2026-09-04T06:44:30.578Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.583Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a3663ed33f45e7c7a3b24151: start","job_status":"start","queue_duration_s":1.85497,"scheduling_latency_s":1.854984}2001gitlab # [ 246.201651] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:32 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 442002gitlab # [ 246.203376] gitaly[900]: time="2026-09-04T06:44:32.436Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NJJVG83THZ8E25EMSZC6AW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=198 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:32.429" grpc.time_ms=6.502 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2003gitlab # [ 246.215455] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.475Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a3663ed33f45e7c7a3b24151","created_at":"2026-09-04T06:44:30.578Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.583Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a3663ed33f45e7c7a3b24151: done: 0.037565 sec","job_status":"done","queue_duration_s":1.85497,"scheduling_latency_s":1.854984,"redis_calls":10,"redis_duration_s":0.001554,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201701,"duration_s":0.037565,"completed_at":"2026-09-04T06:44:32.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2004gitlab # [ 246.259861] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.476Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9b908f4dd01eab6c0cc43e70","created_at":"2026-09-04T06:44:30.598Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.604Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9b908f4dd01eab6c0cc43e70: start","job_status":"start","queue_duration_s":1.872234,"scheduling_latency_s":1.872247}2005gitlab # [ 246.299636] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.496Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9b908f4dd01eab6c0cc43e70","created_at":"2026-09-04T06:44:30.598Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.604Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9b908f4dd01eab6c0cc43e70: done: 0.020013 sec","job_status":"done","queue_duration_s":1.872234,"scheduling_latency_s":1.872247,"redis_calls":10,"redis_duration_s":0.001278,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206451,"duration_s":0.020013,"completed_at":"2026-09-04T06:44:32.496Z","load_balancing_strategy":"primary","db_duration_s":0.002882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 246.346848] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.497Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"46e506d70a8fd701bbcadc20","created_at":"2026-09-04T06:44:30.617Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.620Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-46e506d70a8fd701bbcadc20: start","job_status":"start","queue_duration_s":1.877152,"scheduling_latency_s":1.877172}2007gitlab # [ 246.360978] gitaly[900]: time="2026-09-04T06:44:32.561Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVHPW76WS8E8538ERD67 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:32.554" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2008gitlab # [ 246.370446] gitlab-workhorse[826]: time="2026-09-04T06:44:32Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672009gitlab # [ 246.372245] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:32 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1232010gitlab # [ 246.374064] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:32 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 412011gitlab # [ 246.376049] gitlab-workhorse[826]: time="2026-09-04T06:44:32Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672012gitlab # [ 246.377780] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:32 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 482013gitlab # [ 246.379731] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.648Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"46e506d70a8fd701bbcadc20","created_at":"2026-09-04T06:44:30.617Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.620Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-46e506d70a8fd701bbcadc20: done: 0.150544 sec","job_status":"done","queue_duration_s":1.877152,"scheduling_latency_s":1.877172,"redis_calls":13,"redis_duration_s":0.00848,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003148,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000347251,"duration_s":0.150544,"completed_at":"2026-09-04T06:44:32.648Z","load_balancing_strategy":"primary","db_duration_s":0.00767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2014gitlab # [ 246.420523] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.650Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f48a3ec6f4c28d367118c812","created_at":"2026-09-04T06:44:30.621Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.624Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f48a3ec6f4c28d367118c812: start","job_status":"start","queue_duration_s":2.025759,"scheduling_latency_s":2.025779}2015gitlab # [ 246.435664] gitaly[900]: time="2026-09-04T06:44:32.561Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVHPW76WS8E8538ERD67 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:32.554" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2016gitlab # [ 246.436577] nixbot[2605]: {"ts": "2026-09-04T06:44:32.714Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 \"HTTP/1.1 201 Created\""}2017gitlab # [ 246.437264] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f48a3ec6f4c28d367118c812","created_at":"2026-09-04T06:44:30.621Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.624Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f48a3ec6f4c28d367118c812: done: 0.028383 sec","job_status":"done","queue_duration_s":2.025759,"scheduling_latency_s":2.025779,"redis_calls":10,"redis_duration_s":0.003614,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000312,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002351,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000639467,"duration_s":0.028383,"completed_at":"2026-09-04T06:44:32.678Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2018gitlab # [ 246.450674] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.680Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"69971900b5821e9fe50f05ad","created_at":"2026-09-04T06:44:30.624Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.628Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-69971900b5821e9fe50f05ad: start","job_status":"start","queue_duration_s":2.051898,"scheduling_latency_s":2.051912}2019gitlab # [ 246.501965] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e441c531bcadf2c8ccc5f608d9337067130f1e75 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 4612020gitlab # [ 246.502698] gitaly[900]: time="2026-09-04T06:44:32.561Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVHPW76WS8E8538ERD67 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:32.554" grpc.time_ms=6.544 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2021gitlab # [ 246.503571] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.707Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"69971900b5821e9fe50f05ad","created_at":"2026-09-04T06:44:30.624Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.628Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-69971900b5821e9fe50f05ad: done: 0.02739 sec","job_status":"done","queue_duration_s":2.051898,"scheduling_latency_s":2.051912,"redis_calls":11,"redis_duration_s":0.004033999999999999,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000609,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002486,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000407594,"duration_s":0.02739,"completed_at":"2026-09-04T06:44:32.707Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2022gitlab # [ 246.547423] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.708Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ad8d6f9836c43a61079e9571","created_at":"2026-09-04T06:44:30.630Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.633Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ad8d6f9836c43a61079e9571: start","job_status":"start","queue_duration_s":2.075463,"scheduling_latency_s":2.075477}2023gitlab # [ 246.548191] gitaly[900]: time="2026-09-04T06:44:32.623Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJJVP6PJ9MMG2W3KH0F0M3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:32.613" grpc.time_ms=9.764 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2024gitlab # [ 246.548738] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.740Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ad8d6f9836c43a61079e9571","created_at":"2026-09-04T06:44:30.630Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.633Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ad8d6f9836c43a61079e9571: done: 0.032 sec","job_status":"done","queue_duration_s":2.075463,"scheduling_latency_s":2.075477,"redis_calls":10,"redis_duration_s":0.001908,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000323,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217904,"duration_s":0.032,"completed_at":"2026-09-04T06:44:32.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 246.587959] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.742Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6444a589ff7db4faec8a0ef9","created_at":"2026-09-04T06:44:30.634Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.637Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6444a589ff7db4faec8a0ef9: start","job_status":"start","queue_duration_s":2.104504,"scheduling_latency_s":2.104549}2026gitlab # [ 246.636160] gitaly[900]: time="2026-09-04T06:44:32.663Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NJJVBWG3JBBDZCC0HMXG5R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:42.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:32.656" grpc.time_ms=7.687 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 246.636922] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.775Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6444a589ff7db4faec8a0ef9","created_at":"2026-09-04T06:44:30.634Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.637Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6444a589ff7db4faec8a0ef9: done: 0.033133 sec","job_status":"done","queue_duration_s":2.104504,"scheduling_latency_s":2.104549,"redis_calls":10,"redis_duration_s":0.004364,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216787,"duration_s":0.033133,"completed_at":"2026-09-04T06:44:32.775Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2028gitlab # [ 246.654588] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.776Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6d506279cdaeed9bedcf9536","created_at":"2026-09-04T06:44:30.642Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.645Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6d506279cdaeed9bedcf9536: start","job_status":"start","queue_duration_s":2.131268,"scheduling_latency_s":2.131306}2029gitlab # [ 246.669553] gitaly[900]: time="2026-09-04T06:44:32.673Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVQH3EXN79C22JKY1KEV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:32.665" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2030gitlab # [ 246.713939] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6d506279cdaeed9bedcf9536","created_at":"2026-09-04T06:44:30.642Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.645Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6d506279cdaeed9bedcf9536: done: 0.0232 sec","job_status":"done","queue_duration_s":2.131268,"scheduling_latency_s":2.131306,"redis_calls":10,"redis_duration_s":0.001228,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000235,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189131,"duration_s":0.0232,"completed_at":"2026-09-04T06:44:32.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031gitlab # [ 246.755889] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.800Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1e7fa932b979357143c135da","created_at":"2026-09-04T06:44:30.646Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.654Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1e7fa932b979357143c135da: start","job_status":"start","queue_duration_s":2.145606,"scheduling_latency_s":2.145619}2032gitlab # [ 246.756578] gitaly[900]: time="2026-09-04T06:44:32.673Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVQH3EXN79C22JKY1KEV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:32.665" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2033gitlab # [ 246.757285] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.817Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1e7fa932b979357143c135da","created_at":"2026-09-04T06:44:30.646Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.654Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1e7fa932b979357143c135da: done: 0.016778 sec","job_status":"done","queue_duration_s":2.145606,"scheduling_latency_s":2.145619,"redis_calls":10,"redis_duration_s":0.001519,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000408,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227682,"duration_s":0.016778,"completed_at":"2026-09-04T06:44:32.817Z","load_balancing_strategy":"primary","db_duration_s":0.001537,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2034gitlab # [ 246.805389] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.818Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"4ad25639f89abe6f072cbfd2","created_at":"2026-09-04T06:44:30.655Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.660Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4ad25639f89abe6f072cbfd2: start","job_status":"start","queue_duration_s":2.157632,"scheduling_latency_s":2.157646}2035gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee'2036gitlab # [ 246.806148] gitaly[900]: time="2026-09-04T06:44:32.673Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVQH3EXN79C22JKY1KEV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:32.665" grpc.time_ms=8.136 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2037gitlab # [ 246.813062] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.849Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"4ad25639f89abe6f072cbfd2","created_at":"2026-09-04T06:44:30.655Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.660Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4ad25639f89abe6f072cbfd2: done: 0.03086 sec","job_status":"done","queue_duration_s":2.157632,"scheduling_latency_s":2.157646,"redis_calls":10,"redis_duration_s":0.001589,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000239975,"duration_s":0.03086,"completed_at":"2026-09-04T06:44:32.849Z","load_balancing_strategy":"primary","db_duration_s":0.006593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2038gitlab # [ 246.858187] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.850Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"8ed56cdb7fdf1e4d41553471","created_at":"2026-09-04T06:44:30.667Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.674Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-8ed56cdb7fdf1e4d41553471: start","job_status":"start","queue_duration_s":2.176661,"scheduling_latency_s":2.17668}2039gitlab # [ 246.865129] gitaly[900]: time="2026-09-04T06:44:32.739Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:02.638" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:32.738" grpc.time_ms=0.568 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2040gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee', in 0.10 seconds)2041(finished: subtest: push delivers the webhook, in 51.78 seconds)2042subtest: eval and build post commit statuses2043gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses2044gitlab # [ 246.876803] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.898Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"8ed56cdb7fdf1e4d41553471","created_at":"2026-09-04T06:44:30.667Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.674Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-8ed56cdb7fdf1e4d41553471: done: 0.04805 sec","job_status":"done","queue_duration_s":2.176661,"scheduling_latency_s":2.17668,"redis_calls":14,"redis_duration_s":0.002659,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227962,"duration_s":0.04805,"completed_at":"2026-09-04T06:44:32.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2045gitlab # [ 246.926562] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:32.899Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"b53d1e17f116bb11d8a8e02f","created_at":"2026-09-04T06:44:30.750Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.752Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b53d1e17f116bb11d8a8e02f: start","job_status":"start","queue_duration_s":2.147169,"scheduling_latency_s":2.147183}2046gitlab # [ 246.967775] gitaly[900]: time="2026-09-04T06:44:32.828Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=75 command.spawn_token_fork_ms=69 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T06:45:02.652" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:32.752" grpc.time_ms=76.052 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047gitlab # [ 246.968871] nixbot[2605]: INFO: ::ffff:127.0.0.1:39098 - "GET /api/repos/gitlab/root/test-flake/builds?commit=5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 200 OK2048gitlab # [ 246.969733] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.093Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"b53d1e17f116bb11d8a8e02f","created_at":"2026-09-04T06:44:30.750Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.752Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2557,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b53d1e17f116bb11d8a8e02f: rescheduled"}2049gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses, in 0.09 seconds)2050gitlab # [ 246.970402] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.100Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"b53d1e17f116bb11d8a8e02f","created_at":"2026-09-04T06:44:30.750Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-f94421c852e14499","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.752Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b53d1e17f116bb11d8a8e02f: done: 0.200752 sec","job_status":"done","queue_duration_s":2.147169,"scheduling_latency_s":2.147183,"gitaly_calls":3,"gitaly_duration_s":0.089238,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008828,"redis_read_bytes":149,"redis_write_bytes":18016,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000328,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000727,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.001874,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12315,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003248,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000193,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001023,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08591,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.174973914,"duration_s":0.200752,"completed_at":"2026-09-04T06:44:33.100Z","load_balancing_strategy":"primary","db_duration_s":0.021928,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2051gitlab # [ 247.011572] gitaly[900]: time="2026-09-04T06:44:32.842Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:42.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:32.836" grpc.time_ms=5.753 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 247.016913] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.101Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"62883759283ad5decfa2a408","created_at":"2026-09-04T06:44:30.838Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-db39e6a33d4a4078","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.846Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-62883759283ad5decfa2a408: start","job_status":"start","queue_duration_s":2.255609,"scheduling_latency_s":2.255637}2053gitlab # [ 247.059542] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.142Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"62883759283ad5decfa2a408","created_at":"2026-09-04T06:44:30.838Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-db39e6a33d4a4078","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:30.846Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-62883759283ad5decfa2a408: done: 0.040828 sec","job_status":"done","queue_duration_s":2.255609,"scheduling_latency_s":2.255637,"redis_calls":19,"redis_duration_s":0.0058720000000000005,"redis_read_bytes":22,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003716,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000337,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001376,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008033703,"duration_s":0.040828,"completed_at":"2026-09-04T06:44:33.142Z","load_balancing_strategy":"primary","db_duration_s":0.005163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2054gitlab # [ 247.072209] gitaly[900]: time="2026-09-04T06:44:32.860Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T06:44:42.030" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:32.860" grpc.time_ms=0.381 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 247.114557] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 682056gitlab # [ 247.115260] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.143Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7e8cfbbe233a025df63e808d"],"class":"WebHooks::LogExecutionWorker","jid":"04863897f7db54f8f8ea9f28","created_at":"2026-09-04T06:44:31.744Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-634c2d93fe374bd8","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7ba19540c23fb90cdf82585a80bd08091fb0bd21d2ac75aad7ea15c5b304f315","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:31.748Z","job_size_bytes":2593,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-04863897f7db54f8f8ea9f28: start","job_status":"start","queue_duration_s":1.39481,"scheduling_latency_s":1.394832}2057gitlab # [ 247.115882] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.225Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7e8cfbbe233a025df63e808d"],"class":"WebHooks::LogExecutionWorker","jid":"04863897f7db54f8f8ea9f28","created_at":"2026-09-04T06:44:31.744Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-634c2d93fe374bd8","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7ba19540c23fb90cdf82585a80bd08091fb0bd21d2ac75aad7ea15c5b304f315","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:31.748Z","job_size_bytes":2593,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-04863897f7db54f8f8ea9f28: done: 0.081901 sec","job_status":"done","queue_duration_s":1.39481,"scheduling_latency_s":1.394832,"redis_calls":10,"redis_duration_s":0.047594,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.046993,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000329372,"duration_s":0.081901,"completed_at":"2026-09-04T06:44:33.225Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2058gitlab # [ 247.159594] gitaly[900]: time="2026-09-04T06:44:32.868Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T06:44:42.032" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:32.863" grpc.time_ms=5.048 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 247.160469] gitaly[900]: time="2026-09-04T06:44:32.966Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:32.966" grpc.time_ms=0.368 pid=900 span.kind=server system=grpc2060gitlab # [ 247.162199] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.227Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ef2cef9d12229974b3a08595"],"class":"WebHooks::LogExecutionWorker","jid":"57a274f01f56b75acf8c096d","created_at":"2026-09-04T06:44:32.375Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-127b156062834dbe","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:75a7954a0e761f39cd001ee1fc42df531af70703cf554c373ec7e8aaf0826cd7","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:32.377Z","job_size_bytes":2592,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-57a274f01f56b75acf8c096d: start","job_status":"start","queue_duration_s":0.849902,"scheduling_latency_s":0.849921}2061gitlab # [ 247.178211] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.254Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ef2cef9d12229974b3a08595"],"class":"WebHooks::LogExecutionWorker","jid":"57a274f01f56b75acf8c096d","created_at":"2026-09-04T06:44:32.375Z","trace_propagation_headers":{"sentry-trace":"9be0fc74d26b4230ab1bb1cae8cc94e0-127b156062834dbe","baggage":"sentry-trace_id=9be0fc74d26b4230ab1bb1cae8cc94e0,sentry-release=Unknown"},"correlation_id":"01M1NJH9XKCVK6T28VZWZ97CZY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:75a7954a0e761f39cd001ee1fc42df531af70703cf554c373ec7e8aaf0826cd7","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:32.377Z","job_size_bytes":2592,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-57a274f01f56b75acf8c096d: done: 0.027587 sec","job_status":"done","queue_duration_s":0.849902,"scheduling_latency_s":0.849921,"redis_calls":7,"redis_duration_s":0.005241,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027587,"completed_at":"2026-09-04T06:44:33.254Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2062gitlab # [ 247.219119] gitaly[900]: time="2026-09-04T06:44:32.992Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:32.992" grpc.time_ms=0.353 pid=900 span.kind=server system=grpc2063gitlab # [ 247.259976] gitaly[900]: time="2026-09-04T06:44:33.013Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:33.012" grpc.time_ms=0.681 pid=900 span.kind=server system=grpc2064gitlab # [ 247.260636] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"0d587e14efab7f680e4bab5a","created_at":"2026-09-04T06:44:32.937Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:32.939Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-0d587e14efab7f680e4bab5a: start","job_status":"start","queue_duration_s":0.316686,"scheduling_latency_s":0.316704}2065gitlab # [ 247.261433] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.285Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"0d587e14efab7f680e4bab5a","created_at":"2026-09-04T06:44:32.937Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:32.939Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-0d587e14efab7f680e4bab5a: done: 0.029624 sec","job_status":"done","queue_duration_s":0.316686,"scheduling_latency_s":0.316704,"redis_calls":7,"redis_duration_s":0.0015359999999999998,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029624,"completed_at":"2026-09-04T06:44:33.285Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006012,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2066gitlab # [ 247.301164] gitaly[900]: time="2026-09-04T06:44:33.024Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW diskcache=bf4abd79-f343-4c57-aefc-07c9474f096e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:02.642" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:32.943" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab # [ 247.301783] gitaly[900]: time="2026-09-04T06:44:33.025Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=80 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7625 command.oublock=0 command.real_time_ms=73 command.spawn_token_fork_ms=0 command.system_time_ms=58 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:02.642" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:32.943" grpc.time_ms=81.796 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 247.310073] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.286Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5c533d9ebb90a0815dd500d5","created_at":"2026-09-04T06:44:33.029Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.031Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5c533d9ebb90a0815dd500d5: start","job_status":"start","queue_duration_s":0.255278,"scheduling_latency_s":0.255297}2069gitlab # [ 247.349444] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.307Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5c533d9ebb90a0815dd500d5","created_at":"2026-09-04T06:44:33.029Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.031Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5c533d9ebb90a0815dd500d5: done: 0.021507 sec","job_status":"done","queue_duration_s":0.255278,"scheduling_latency_s":0.255297,"redis_calls":7,"redis_duration_s":0.001145,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021507,"completed_at":"2026-09-04T06:44:33.307Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2070gitlab # [ 247.362257] gitaly[900]: time="2026-09-04T06:44:33.061Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:45:03.060" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:33.060" grpc.time_ms=0.849 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 247.405686] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8bf1176106dc9299ca3c6e32","created_at":"2026-09-04T06:44:33.035Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.037Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8bf1176106dc9299ca3c6e32: start","job_status":"start","queue_duration_s":0.271603,"scheduling_latency_s":0.271621}2072gitlab # [ 247.406552] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.333Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8bf1176106dc9299ca3c6e32","created_at":"2026-09-04T06:44:33.035Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.037Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8bf1176106dc9299ca3c6e32: done: 0.024075 sec","job_status":"done","queue_duration_s":0.271603,"scheduling_latency_s":0.271621,"redis_calls":7,"redis_duration_s":0.001368,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024075,"completed_at":"2026-09-04T06:44:33.333Z","load_balancing_strategy":"primary","db_duration_s":0.008852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2073gitlab # [ 247.465521] gitaly[900]: time="2026-09-04T06:44:33.088Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJHA6M98FEJEV7E2KMWQNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:03.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:33.087" grpc.time_ms=0.49 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 247.466312] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.334Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"32eac13c367374d68bb8fc10","created_at":"2026-09-04T06:44:33.043Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.044Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-32eac13c367374d68bb8fc10: start","job_status":"start","queue_duration_s":0.289612,"scheduling_latency_s":0.289626}2075gitlab # [ 247.466838] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.353Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"32eac13c367374d68bb8fc10","created_at":"2026-09-04T06:44:33.043Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.044Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-32eac13c367374d68bb8fc10: done: 0.019188 sec","job_status":"done","queue_duration_s":0.289612,"scheduling_latency_s":0.289626,"redis_calls":10,"redis_duration_s":0.001402,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000411,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019188,"completed_at":"2026-09-04T06:44:33.353Z","load_balancing_strategy":"primary","db_duration_s":0.003608,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2076gitlab # [ 247.519763] gitaly[900]: time="2026-09-04T06:44:33.319Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJWBNE65VGBHKGTJZPY76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:03.017" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:33.318" grpc.time_ms=0.845 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 247.520596] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.354Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7ba6964c55d13acef57175e0","created_at":"2026-09-04T06:44:33.044Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.045Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7ba6964c55d13acef57175e0: start","job_status":"start","queue_duration_s":0.308789,"scheduling_latency_s":0.308803}2078gitlab # [ 247.521071] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.372Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7ba6964c55d13acef57175e0","created_at":"2026-09-04T06:44:33.044Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.045Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7ba6964c55d13acef57175e0: done: 0.017696 sec","job_status":"done","queue_duration_s":0.308789,"scheduling_latency_s":0.308803,"redis_calls":7,"redis_duration_s":0.0011099999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017696,"completed_at":"2026-09-04T06:44:33.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 247.562971] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.373Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"26d54575577a96626edb79f6","created_at":"2026-09-04T06:44:33.046Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.047Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-26d54575577a96626edb79f6: start","job_status":"start","queue_duration_s":0.325361,"scheduling_latency_s":0.325374}2080gitlab # [ 247.570960] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.388Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"26d54575577a96626edb79f6","created_at":"2026-09-04T06:44:33.046Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.047Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-26d54575577a96626edb79f6: done: 0.015509 sec","job_status":"done","queue_duration_s":0.325361,"scheduling_latency_s":0.325374,"redis_calls":8,"redis_duration_s":0.001184,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015509,"completed_at":"2026-09-04T06:44:33.388Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2081gitlab # [ 247.622595] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.389Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3be2609e4b426ca27e4bdfaa","created_at":"2026-09-04T06:44:33.048Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.049Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3be2609e4b426ca27e4bdfaa: start","job_status":"start","queue_duration_s":0.340249,"scheduling_latency_s":0.340262}2082gitlab # [ 247.624463] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.409Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3be2609e4b426ca27e4bdfaa","created_at":"2026-09-04T06:44:33.048Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.049Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3be2609e4b426ca27e4bdfaa: done: 0.020113 sec","job_status":"done","queue_duration_s":0.340249,"scheduling_latency_s":0.340262,"redis_calls":7,"redis_duration_s":0.0011459999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000326,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020113,"completed_at":"2026-09-04T06:44:33.409Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2083gitlab # [ 247.666782] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.410Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5cfc25bac88b76f6e354f509","created_at":"2026-09-04T06:44:33.049Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.050Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5cfc25bac88b76f6e354f509: start","job_status":"start","queue_duration_s":0.360586,"scheduling_latency_s":0.360612}2084gitlab # [ 247.707909] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.432Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5cfc25bac88b76f6e354f509","created_at":"2026-09-04T06:44:33.049Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.050Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5cfc25bac88b76f6e354f509: done: 0.021723 sec","job_status":"done","queue_duration_s":0.360586,"scheduling_latency_s":0.360612,"redis_calls":7,"redis_duration_s":0.001177,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021723,"completed_at":"2026-09-04T06:44:33.432Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003814,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2085gitlab # [ 247.747048] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.433Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f7b33e0a3e58eab118abf754","created_at":"2026-09-04T06:44:33.050Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.051Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f7b33e0a3e58eab118abf754: start","job_status":"start","queue_duration_s":0.382346,"scheduling_latency_s":0.382368}2086gitlab # [ 247.747724] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.444Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f7b33e0a3e58eab118abf754","created_at":"2026-09-04T06:44:33.050Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.051Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f7b33e0a3e58eab118abf754: done: 0.010384 sec","job_status":"done","queue_duration_s":0.382346,"scheduling_latency_s":0.382368,"redis_calls":7,"redis_duration_s":0.000873,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010384,"completed_at":"2026-09-04T06:44:33.444Z","load_balancing_strategy":"primary","db_duration_s":0.000359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2087gitlab # [ 247.788630] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.445Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b93a4d39d68611db81b644b8","created_at":"2026-09-04T06:44:33.051Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.052Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b93a4d39d68611db81b644b8: start","job_status":"start","queue_duration_s":0.392541,"scheduling_latency_s":0.392554}2088gitlab # [ 247.789517] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.460Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b93a4d39d68611db81b644b8","created_at":"2026-09-04T06:44:33.051Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.052Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b93a4d39d68611db81b644b8: done: 0.0156 sec","job_status":"done","queue_duration_s":0.392541,"scheduling_latency_s":0.392554,"redis_calls":7,"redis_duration_s":0.000863,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0156,"completed_at":"2026-09-04T06:44:33.460Z","load_balancing_strategy":"primary","db_duration_s":0.002898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2089gitlab # [ 247.835132] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.461Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9f9526eb534e1e8adb510b0c","created_at":"2026-09-04T06:44:33.094Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.096Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9f9526eb534e1e8adb510b0c: start","job_status":"start","queue_duration_s":0.365056,"scheduling_latency_s":0.365069}2090gitlab # [ 247.835796] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.480Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9f9526eb534e1e8adb510b0c","created_at":"2026-09-04T06:44:33.094Z","trace_propagation_headers":{"sentry-trace":"9c3925bc8ec54e4689344d9dec7e72b6-bb7ed5ddbd784d9b","baggage":"sentry-trace_id=9c3925bc8ec54e4689344d9dec7e72b6,sentry-release=Unknown"},"correlation_id":"01M1NJHA6M98FEJEV7E2KMWQNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.096Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9f9526eb534e1e8adb510b0c: done: 0.019125 sec","job_status":"done","queue_duration_s":0.365056,"scheduling_latency_s":0.365069,"redis_calls":8,"redis_duration_s":0.003487,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002382,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019125,"completed_at":"2026-09-04T06:44:33.480Z","load_balancing_strategy":"primary","db_duration_s":0.002646,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091gitlab # [ 247.900671] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.481Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"c9d918d5171d5ebf4f27083d","created_at":"2026-09-04T06:44:33.129Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-e5fd634d2887431f","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.135Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-c9d918d5171d5ebf4f27083d: start","job_status":"start","queue_duration_s":0.346379,"scheduling_latency_s":0.346393}2092gitlab # [ 247.901450] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:33.537Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"c9d918d5171d5ebf4f27083d","created_at":"2026-09-04T06:44:33.129Z","trace_propagation_headers":{"sentry-trace":"1b667ea60cf84366b890b158316e2037-e5fd634d2887431f","baggage":"sentry-trace_id=1b667ea60cf84366b890b158316e2037,sentry-release=Unknown"},"correlation_id":"01M1NJH5DR85A82QE4WM7816B4","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:33.135Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-c9d918d5171d5ebf4f27083d: done: 0.056024 sec","job_status":"done","queue_duration_s":0.346379,"scheduling_latency_s":0.346393,"redis_calls":11,"redis_duration_s":0.001541,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234667,"duration_s":0.056024,"completed_at":"2026-09-04T06:44:33.537Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2093gitlab # [ 247.968876] gitaly[900]: time="2026-09-04T06:44:34.272Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:34.272" grpc.time_ms=0.404 pid=900 span.kind=server system=grpc2094gitlab # [ 247.999835] gitaly[900]: time="2026-09-04T06:44:34.304Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:34.302" grpc.time_ms=1.018 pid=900 span.kind=server system=grpc2095gitlab # [ 248.016653] gitaly[900]: time="2026-09-04T06:44:34.320Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 diskcache=0134a59e-c741-4e4a-b65e-7be61edfb027 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:44:42.040" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:32.870" pid=900 ref=refs/keep-around/5802e58b9ea85d54624c49ab9ff40b06d35bfcee remote_ip="2001:db8:1::1" revision=5802e58b9ea85d54624c49ab9ff40b06d35bfcee span.kind=server system=grpc username=root2096gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses2097gitlab # [ 248.017679] gitaly[900]: time="2026-09-04T06:44:34.321Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=114 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=856064 command.minflt=5249 command.oublock=8 command.real_time_ms=1442 command.spawn_token_fork_ms=447 command.system_time_ms=84 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:44:42.040" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:44:32.870" grpc.time_ms=1450.692 pid=900 ref=refs/keep-around/5802e58b9ea85d54624c49ab9ff40b06d35bfcee remote_ip="2001:db8:1::1" revision=5802e58b9ea85d54624c49ab9ff40b06d35bfcee span.kind=server system=grpc username=root2098gitlab # [ 248.019934] gitaly[900]: time="2026-09-04T06:44:34.324Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:04.223" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:34.323" grpc.time_ms=0.33 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 248.025560] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:34.329Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b802c1496964bc0d7e198f7f","created_at":"2026-09-04T06:44:34.326Z","trace_propagation_headers":{"sentry-trace":"ae41813e11f9462dafeeccdba20c1f82-ba97dae66bdf4615","baggage":"sentry-trace_id=ae41813e11f9462dafeeccdba20c1f82,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJJVSZT1EQKRBVK4CNFST2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:34.328Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b802c1496964bc0d7e198f7f: start","job_status":"start","queue_duration_s":0.001264,"scheduling_latency_s":0.001295}2100gitlab # [ 248.047570] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:34.351Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b802c1496964bc0d7e198f7f","created_at":"2026-09-04T06:44:34.326Z","trace_propagation_headers":{"sentry-trace":"ae41813e11f9462dafeeccdba20c1f82-ba97dae66bdf4615","baggage":"sentry-trace_id=ae41813e11f9462dafeeccdba20c1f82,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJJVSZT1EQKRBVK4CNFST2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:34.328Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b802c1496964bc0d7e198f7f: done: 0.022099 sec","job_status":"done","queue_duration_s":0.001264,"scheduling_latency_s":0.001295,"redis_calls":7,"redis_duration_s":0.001298,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022099,"completed_at":"2026-09-04T06:44:34.351Z","load_balancing_strategy":"primary","db_duration_s":0.003301,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2101gitlab # [ 248.064674] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:34.358Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8e906f7b5ab0b209cd75ad52","created_at":"2026-09-04T06:44:34.330Z","trace_propagation_headers":{"sentry-trace":"ae41813e11f9462dafeeccdba20c1f82-ba97dae66bdf4615","baggage":"sentry-trace_id=ae41813e11f9462dafeeccdba20c1f82,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJJVSZT1EQKRBVK4CNFST2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:34.336Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8e906f7b5ab0b209cd75ad52: start","job_status":"start","queue_duration_s":0.022128,"scheduling_latency_s":0.022145}2102gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses, in 0.09 seconds)2103gitlab # [ 248.110474] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:34.414Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8e906f7b5ab0b209cd75ad52","created_at":"2026-09-04T06:44:34.330Z","trace_propagation_headers":{"sentry-trace":"ae41813e11f9462dafeeccdba20c1f82-ba97dae66bdf4615","baggage":"sentry-trace_id=ae41813e11f9462dafeeccdba20c1f82,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJJVSZT1EQKRBVK4CNFST2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:34.336Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8e906f7b5ab0b209cd75ad52: done: 0.056064 sec","job_status":"done","queue_duration_s":0.022128,"scheduling_latency_s":0.022145,"redis_calls":10,"redis_duration_s":0.00703,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003998,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.003032,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056064,"completed_at":"2026-09-04T06:44:34.414Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2104gitlab # [ 248.156354] gitaly[900]: time="2026-09-04T06:44:34.412Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJXE6RN4EX4NWBEYPV3W1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:04.111" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:34.411" grpc.time_ms=0.839 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab # [ 248.157268] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 17042106gitlab # [ 248.157841] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 542107gitlab # [ 248.158651] nixbot[2605]: {"ts": "2026-09-04T06:44:34.409Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5802e58b9ea85d54624c49ab9ff40b06d35bfcee \"HTTP/1.1 201 Created\""}2108gitlab # [ 248.158818] nixbot[2605]: {"ts": "2026-09-04T06:44:34.422Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-5802e58b9ea8-5"}2109gitlab # [ 248.159078] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:34.416Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"56f798e4746b3f2dbde6a049","created_at":"2026-09-04T06:44:34.386Z","trace_propagation_headers":{"sentry-trace":"ae41813e11f9462dafeeccdba20c1f82-ba97dae66bdf4615","baggage":"sentry-trace_id=ae41813e11f9462dafeeccdba20c1f82,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJJVSZT1EQKRBVK4CNFST2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:34.392Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-56f798e4746b3f2dbde6a049: start","job_status":"start","queue_duration_s":0.023896,"scheduling_latency_s":0.023912}2110gitlab # [ 248.165400] gitaly[900]: time="2026-09-04T06:44:34.469Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:45:04.168" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:34.468" grpc.time_ms=0.768 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 248.190983] gitaly[900]: time="2026-09-04T06:44:34.495Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJVSZT1EQKRBVK4CNFST2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:04.194" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:34.494" grpc.time_ms=0.721 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 248.205326] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:34.509Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"56f798e4746b3f2dbde6a049","created_at":"2026-09-04T06:44:34.386Z","trace_propagation_headers":{"sentry-trace":"ae41813e11f9462dafeeccdba20c1f82-ba97dae66bdf4615","baggage":"sentry-trace_id=ae41813e11f9462dafeeccdba20c1f82,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJJVSZT1EQKRBVK4CNFST2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:34.392Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-56f798e4746b3f2dbde6a049: done: 0.092701 sec","job_status":"done","queue_duration_s":0.023896,"scheduling_latency_s":0.023912,"gitaly_calls":2,"gitaly_duration_s":0.006311,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006946,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000607,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001693,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000178,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001134,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000156,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000515,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002056,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064459,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06435371,"duration_s":0.092701,"completed_at":"2026-09-04T06:44:34.509Z","load_balancing_strategy":"primary","db_duration_s":0.017411,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2113gitlab # [ 248.222172] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:34.513Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d2e9ccbab593f3a06ccecd8f","created_at":"2026-09-04T06:44:34.458Z","trace_propagation_headers":{"sentry-trace":"ae41813e11f9462dafeeccdba20c1f82-b90ef302518445e0","baggage":"sentry-trace_id=ae41813e11f9462dafeeccdba20c1f82,sentry-release=Unknown"},"correlation_id":"01M1NJJVSZT1EQKRBVK4CNFST2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:34.459Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d2e9ccbab593f3a06ccecd8f: start","job_status":"start","queue_duration_s":0.053584,"scheduling_latency_s":0.053604}2114gitlab # [ 248.264652] nixbot[2605]: {"ts": "2026-09-04T06:44:34.519Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-5802e58b9ea8-5", "argv0": "bwrap"}2115gitlab # [ 248.265474] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:34.555Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d2e9ccbab593f3a06ccecd8f","created_at":"2026-09-04T06:44:34.458Z","trace_propagation_headers":{"sentry-trace":"ae41813e11f9462dafeeccdba20c1f82-b90ef302518445e0","baggage":"sentry-trace_id=ae41813e11f9462dafeeccdba20c1f82,sentry-release=Unknown"},"correlation_id":"01M1NJJVSZT1EQKRBVK4CNFST2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:34.459Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d2e9ccbab593f3a06ccecd8f: done: 0.041924 sec","job_status":"done","queue_duration_s":0.053584,"scheduling_latency_s":0.053604,"redis_calls":7,"redis_duration_s":0.009439,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041924,"completed_at":"2026-09-04T06:44:34.554Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2116gitlab # [ 248.376943] nix-daemon[2833]: accepted connection from pid 3448, user nixbot2117gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses2118gitlab # [ 249.248602] gitaly[900]: time="2026-09-04T06:44:35.552Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJYGFWY9Q2HCFWM3VVNJR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:05.450" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:35.550" grpc.time_ms=1.045 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab # [ 249.291931] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1232120gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses, in 0.17 seconds)2121gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses2122gitlab # [ 250.405953] gitaly[900]: time="2026-09-04T06:44:36.709Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJJZMZXKPKGAXNJTANF2ZK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:06.607" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:36.708" grpc.time_ms=1.014 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 250.433467] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 972124gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses, in 0.14 seconds)2125gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses2126gitlab # [ 251.563257] gitaly[900]: time="2026-09-04T06:44:37.866Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK0RNDSKYY2VHQ9MP07YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:07.765" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:37.866" grpc.time_ms=0.55 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 251.600754] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1222128gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses, in 0.17 seconds)2129gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses2130gitlab # [ 252.689596] nix-daemon[2833]: accepted connection from pid 3481, user nixbot2131gitlab # [ 252.701956] nix-daemon[2833]: accepted connection from pid 3448, user nixbot2132gitlab # [ 252.732565] gitaly[900]: time="2026-09-04T06:44:39.036Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK1X2WWBVFFJQ9NYPPFN5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:09.034" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:39.035" grpc.time_ms=0.789 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 252.764391] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1212134gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses, in 0.16 seconds)2135gitlab # [ 252.787128] gitaly[900]: time="2026-09-04T06:44:39.091Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:09.090" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:39.090" grpc.time_ms=0.652 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2136gitlab # [ 252.831913] gitaly[900]: time="2026-09-04T06:44:39.136Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:49.115" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.125" grpc.time_ms=10.343 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 252.862043] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.165Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5890213731d9f417abc1824c","created_at":"2026-09-04T06:44:39.159Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-670aa7ba98bc4a56","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.164Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5890213731d9f417abc1824c: start","job_status":"start","queue_duration_s":0.001146,"scheduling_latency_s":0.001175}2138gitlab # [ 252.882351] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1442139gitlab # [ 252.885084] nixbot[2605]: {"ts": "2026-09-04T06:44:39.187Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5802e58b9ea85d54624c49ab9ff40b06d35bfcee \"HTTP/1.1 201 Created\""}2140gitlab # [ 252.929137] gitaly[900]: time="2026-09-04T06:44:39.233Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK24P2H8AXQSBQE71TDQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:09.032" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:39.232" grpc.time_ms=0.45 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 252.959308] gitaly[900]: time="2026-09-04T06:44:39.263Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJK24P2H8AXQSBQE71TDQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:49.117" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.258" grpc.time_ms=5.35 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 252.971844] gitaly[900]: time="2026-09-04T06:44:39.268Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:39.268" grpc.time_ms=0.244 pid=900 span.kind=server system=grpc2143gitlab # [ 252.996494] gitaly[900]: time="2026-09-04T06:44:39.300Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:39.300" grpc.time_ms=0.388 pid=900 span.kind=server system=grpc2144gitlab # [ 253.005515] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1192145gitlab # [ 253.006838] nixbot[2605]: {"ts": "2026-09-04T06:44:39.311Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5802e58b9ea85d54624c49ab9ff40b06d35bfcee \"HTTP/1.1 201 Created\""}2146gitlab # [ 253.021406] gitaly[900]: time="2026-09-04T06:44:39.325Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:39.325" grpc.time_ms=0.352 pid=900 span.kind=server system=grpc2147gitlab # [ 253.032788] gitaly[900]: time="2026-09-04T06:44:39.337Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:09.233" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.233" operations="[repack_refs]" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 253.042316] gitaly[900]: time="2026-09-04T06:44:39.339Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:09.233" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.233" pid=900 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-04 06:43:35.532911983 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2149gitlab # [ 253.056294] gitaly[900]: time="2026-09-04T06:44:39.360Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:09.233" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.233" pid=900 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2150gitlab # [ 253.057694] gitaly[900]: time="2026-09-04T06:44:39.361Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG diskcache=41856eeb-e52d-4ffd-a96e-57be1b17249d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:09.233" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.233" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2151gitlab # [ 253.058682] gitaly[900]: time="2026-09-04T06:44:39.362Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=88 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=8387 command.oublock=0 command.real_time_ms=110 command.spawn_token_fork_ms=4 command.system_time_ms=59 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:09.233" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.233" grpc.time_ms=128.224 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2152gitlab # [ 253.075523] gitaly[900]: time="2026-09-04T06:44:39.379Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK28SRCCTNYM9G9CWZ2FV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:09.277" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:39.378" grpc.time_ms=1.384 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 253.097999] gitaly[900]: time="2026-09-04T06:44:39.402Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:45:09.101" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:39.401" grpc.time_ms=0.625 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 253.104579] gitaly[900]: time="2026-09-04T06:44:39.408Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJK28SRCCTNYM9G9CWZ2FV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:44:49.033" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.403" grpc.time_ms=5.467 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 253.116269] gitaly[900]: time="2026-09-04T06:44:39.420Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:45:09.119" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:44:39.420" grpc.time_ms=0.346 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 253.121847] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.425Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"80b17053ce0356125bc621db","created_at":"2026-09-04T06:44:39.424Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"5890213731d9f417abc1824c","job_size_bytes":3,"pid":2557,"job_status":"deduplicated","message":"PipelineProcessWorker JID-80b17053ce0356125bc621db: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2157gitlab # [ 253.123256] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.427Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5890213731d9f417abc1824c","created_at":"2026-09-04T06:44:39.159Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-670aa7ba98bc4a56","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.164Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2557,"job_status":"rescheduled","message":"PipelineProcessWorker JID-5890213731d9f417abc1824c: rescheduled"}2158gitlab # [ 253.127873] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.431Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5890213731d9f417abc1824c","created_at":"2026-09-04T06:44:39.159Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-670aa7ba98bc4a56","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.164Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5890213731d9f417abc1824c: done: 0.266303 sec","job_status":"done","queue_duration_s":0.001146,"scheduling_latency_s":0.001175,"gitaly_calls":3,"gitaly_duration_s":0.133978,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011643,"redis_read_bytes":239,"redis_write_bytes":21781,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000805,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000731,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002611,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004698,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000196,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000406,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001391,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095125,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.229670811,"duration_s":0.266303,"completed_at":"2026-09-04T06:44:39.431Z","load_balancing_strategy":"primary","db_duration_s":0.023193,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 253.179023] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.433Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5572701ab6bb02e4cbcda41b","created_at":"2026-09-04T06:44:39.227Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.229Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5572701ab6bb02e4cbcda41b: start","job_status":"start","queue_duration_s":0.204222,"scheduling_latency_s":0.204248}2160gitlab # [ 253.183585] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5572701ab6bb02e4cbcda41b","created_at":"2026-09-04T06:44:39.227Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.229Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5572701ab6bb02e4cbcda41b: done: 0.034859 sec","job_status":"done","queue_duration_s":0.204222,"scheduling_latency_s":0.204248,"redis_calls":7,"redis_duration_s":0.000914,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034859,"completed_at":"2026-09-04T06:44:39.468Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005418,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2161gitlab # [ 253.250737] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5802e58b9ea85d54624c49ab9ff40b06d35bfcee HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1282162gitlab # [ 253.251385] nixbot[2605]: {"ts": "2026-09-04T06:44:39.451Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5802e58b9ea85d54624c49ab9ff40b06d35bfcee \"HTTP/1.1 201 Created\""}2163gitlab # [ 253.251815] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.469Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3dfdcfba4104757e2f05d084","created_at":"2026-09-04T06:44:39.366Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.370Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3dfdcfba4104757e2f05d084: start","job_status":"start","queue_duration_s":0.099356,"scheduling_latency_s":0.099372}2164gitlab # [ 253.254123] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.497Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3dfdcfba4104757e2f05d084","created_at":"2026-09-04T06:44:39.366Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.370Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3dfdcfba4104757e2f05d084: done: 0.027512 sec","job_status":"done","queue_duration_s":0.099356,"scheduling_latency_s":0.099372,"redis_calls":7,"redis_duration_s":0.0029319999999999997,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027512,"completed_at":"2026-09-04T06:44:39.497Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 253.280677] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6e65297fba95c0ffd31a2607","created_at":"2026-09-04T06:44:39.375Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.377Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6e65297fba95c0ffd31a2607: start","job_status":"start","queue_duration_s":0.123346,"scheduling_latency_s":0.123364}2166gitlab # [ 253.322029] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.528Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6e65297fba95c0ffd31a2607","created_at":"2026-09-04T06:44:39.375Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.377Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6e65297fba95c0ffd31a2607: done: 0.027614 sec","job_status":"done","queue_duration_s":0.123346,"scheduling_latency_s":0.123364,"redis_calls":7,"redis_duration_s":0.0015869999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027614,"completed_at":"2026-09-04T06:44:39.528Z","load_balancing_strategy":"primary","db_duration_s":0.005857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2167gitlab # [ 253.331926] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.529Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"9f6dcb1668cdd12d0e83dfd6","created_at":"2026-09-04T06:44:39.382Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.383Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9f6dcb1668cdd12d0e83dfd6: start","job_status":"start","queue_duration_s":0.145869,"scheduling_latency_s":0.145886}2168gitlab # [ 253.376681] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.550Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"9f6dcb1668cdd12d0e83dfd6","created_at":"2026-09-04T06:44:39.382Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.383Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9f6dcb1668cdd12d0e83dfd6: done: 0.021686 sec","job_status":"done","queue_duration_s":0.145869,"scheduling_latency_s":0.145886,"redis_calls":10,"redis_duration_s":0.001429,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000415,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021686,"completed_at":"2026-09-04T06:44:39.550Z","load_balancing_strategy":"primary","db_duration_s":0.004286,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2169gitlab # [ 253.424028] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.551Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4e42e16403ae94aa745a6ae9","created_at":"2026-09-04T06:44:39.383Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.384Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4e42e16403ae94aa745a6ae9: start","job_status":"start","queue_duration_s":0.167185,"scheduling_latency_s":0.167202}2170gitlab # [ 253.424765] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.571Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4e42e16403ae94aa745a6ae9","created_at":"2026-09-04T06:44:39.383Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.384Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4e42e16403ae94aa745a6ae9: done: 0.019973 sec","job_status":"done","queue_duration_s":0.167185,"scheduling_latency_s":0.167202,"redis_calls":7,"redis_duration_s":0.001034,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019973,"completed_at":"2026-09-04T06:44:39.571Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2171gitlab # [ 253.442140] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.572Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"71f0b5fe1e7bfe0726852efe","created_at":"2026-09-04T06:44:39.385Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.386Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-71f0b5fe1e7bfe0726852efe: start","job_status":"start","queue_duration_s":0.186298,"scheduling_latency_s":0.186313}2172gitlab # [ 253.453640] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.592Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"71f0b5fe1e7bfe0726852efe","created_at":"2026-09-04T06:44:39.385Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.386Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-71f0b5fe1e7bfe0726852efe: done: 0.019342 sec","job_status":"done","queue_duration_s":0.186298,"scheduling_latency_s":0.186313,"redis_calls":8,"redis_duration_s":0.003738,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003476,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019342,"completed_at":"2026-09-04T06:44:39.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2173gitlab # [ 253.504795] gitaly[900]: time="2026-09-04T06:44:39.731Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2KSGMZPV17Z0N91G1DQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:39.725" grpc.time_ms=6.346 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2174gitlab # [ 253.505557] gitaly[900]: time="2026-09-04T06:44:39.789Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2NNYPRENBBSRS62ZBXE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:39.781" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2175gitlab # [ 253.512916] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 582176gitlab # [ 253.514344] gitlab-workhorse[826]: time="2026-09-04T06:44:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672177gitlab # [ 253.515674] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 572178gitlab # [ 253.518088] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.593Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a29e5a7c47d7d37af5e85c28","created_at":"2026-09-04T06:44:39.387Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.388Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a29e5a7c47d7d37af5e85c28: start","job_status":"start","queue_duration_s":0.205096,"scheduling_latency_s":0.205112}2179gitlab # [ 253.565938] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.607Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a29e5a7c47d7d37af5e85c28","created_at":"2026-09-04T06:44:39.387Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.388Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a29e5a7c47d7d37af5e85c28: done: 0.014368 sec","job_status":"done","queue_duration_s":0.205096,"scheduling_latency_s":0.205112,"redis_calls":7,"redis_duration_s":0.001429,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014368,"completed_at":"2026-09-04T06:44:39.607Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001568,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2180gitlab # [ 253.571719] gitaly[900]: time="2026-09-04T06:44:39.789Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2NNYPRENBBSRS62ZBXE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:39.781" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2181gitlab # [ 253.622853] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.608Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"68e6d6911bd1b1818598ff33","created_at":"2026-09-04T06:44:39.388Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.389Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-68e6d6911bd1b1818598ff33: start","job_status":"start","queue_duration_s":0.219024,"scheduling_latency_s":0.219039}2182gitlab # [ 253.623769] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.632Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"68e6d6911bd1b1818598ff33","created_at":"2026-09-04T06:44:39.388Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.389Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-68e6d6911bd1b1818598ff33: done: 0.023712 sec","job_status":"done","queue_duration_s":0.219024,"scheduling_latency_s":0.219039,"redis_calls":7,"redis_duration_s":0.003332,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023712,"completed_at":"2026-09-04T06:44:39.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 253.637974] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 762184gitlab # [ 253.639886] gitaly[900]: time="2026-09-04T06:44:39.789Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2NNYPRENBBSRS62ZBXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:39.781" grpc.time_ms=7.73 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2185gitlab # [ 253.653636] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.635Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"7cec43f56bcf0b6a25831da1","created_at":"2026-09-04T06:44:39.391Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.392Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7cec43f56bcf0b6a25831da1: start","job_status":"start","queue_duration_s":0.243255,"scheduling_latency_s":0.243271}2186gitlab # [ 253.668211] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.660Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"7cec43f56bcf0b6a25831da1","created_at":"2026-09-04T06:44:39.391Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.392Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7cec43f56bcf0b6a25831da1: done: 0.024224 sec","job_status":"done","queue_duration_s":0.243255,"scheduling_latency_s":0.243271,"redis_calls":7,"redis_duration_s":0.002576,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00181,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024224,"completed_at":"2026-09-04T06:44:39.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2187gitlab # [ 253.745561] gitaly[900]: time="2026-09-04T06:44:39.801Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:39.801" grpc.time_ms=0.216 pid=900 span.kind=server system=grpc2188gitlab # [ 253.746225] gitaly[900]: time="2026-09-04T06:44:39.852Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:39.852" grpc.time_ms=0.392 pid=900 span.kind=server system=grpc2189gitlab # [ 253.746831] gitlab-workhorse[826]: time="2026-09-04T06:44:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672190gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses2191gitlab # [ 253.747510] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 902192gitlab # [ 253.748073] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.661Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b5470007961f9ad3e7bbfd33","created_at":"2026-09-04T06:44:39.392Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.393Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b5470007961f9ad3e7bbfd33: start","job_status":"start","queue_duration_s":0.268036,"scheduling_latency_s":0.268067}2193gitlab # [ 253.748717] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.679Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b5470007961f9ad3e7bbfd33","created_at":"2026-09-04T06:44:39.392Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.393Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b5470007961f9ad3e7bbfd33: done: 0.01741 sec","job_status":"done","queue_duration_s":0.268036,"scheduling_latency_s":0.268067,"redis_calls":7,"redis_duration_s":0.002091,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001416,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000675,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01741,"completed_at":"2026-09-04T06:44:39.679Z","load_balancing_strategy":"primary","db_duration_s":0.000422,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2194gitlab # [ 253.779900] gitaly[900]: time="2026-09-04T06:44:39.879Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:44:39.878" grpc.time_ms=0.382 pid=900 span.kind=server system=grpc2195gitlab # [ 253.787735] gitaly[900]: time="2026-09-04T06:44:39.888Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG diskcache=0e6fc034-eb6c-4270-ae1a-42270f6072ab grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:09.471" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.772" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 253.797229] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"2c4361dc465aa9a1bfa5425c","created_at":"2026-09-04T06:44:39.394Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.395Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2c4361dc465aa9a1bfa5425c: start","job_status":"start","queue_duration_s":0.289588,"scheduling_latency_s":0.289608}2197gitlab # [ 253.845819] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.710Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"2c4361dc465aa9a1bfa5425c","created_at":"2026-09-04T06:44:39.394Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.395Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2c4361dc465aa9a1bfa5425c: done: 0.025806 sec","job_status":"done","queue_duration_s":0.289588,"scheduling_latency_s":0.289608,"redis_calls":7,"redis_duration_s":0.001885,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025806,"completed_at":"2026-09-04T06:44:39.710Z","load_balancing_strategy":"primary","db_duration_s":0.003874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2198gitlab # [ 253.848398] gitaly[900]: time="2026-09-04T06:44:39.888Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7049 command.oublock=0 command.real_time_ms=108 command.spawn_token_fork_ms=0 command.system_time_ms=34 command.user_time_ms=35 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJK2022MNH29NJRDTMNHWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:45:09.471" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:44:39.772" grpc.time_ms=116.153 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2199gitlab # [ 253.860730] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.712Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"b8a37a8ddf249d52f0bbffe5","created_at":"2026-09-04T06:44:39.427Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.428Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b8a37a8ddf249d52f0bbffe5: start","job_status":"start","queue_duration_s":0.284023,"scheduling_latency_s":0.284041}2200gitlab # [ 253.909600] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.976Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"b8a37a8ddf249d52f0bbffe5","created_at":"2026-09-04T06:44:39.427Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.428Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2557,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b8a37a8ddf249d52f0bbffe5: rescheduled"}2201gitlab # [ 253.910493] gitaly[900]: time="2026-09-04T06:44:39.892Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJK2R7CWC2J31E19HK6FMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:44:39.886" grpc.time_ms=5.63 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2202gitlab # [ 253.911116] gitaly[900]: time="2026-09-04T06:44:39.926Z" level=info msg="optimized repository" clean_stale_data_time=13.58804ms clean_work_trees_time=565.388339ms commit_graph_time="4.749µs" correlation_id=01M1NJK2022MNH29NJRDTMNHWG gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.749µs" pid=900 prune_time="4.19µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="7.263µs" storage_name=default system=housekeeping total_time=579.186461ms2203gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/5802e58b9ea85d54624c49ab9ff40b06d35bfcee/statuses, in 0.18 seconds)2204(finished: subtest: eval and build post commit statuses, in 7.00 seconds)2205(finished: run the VM test script, in 307.08 seconds)2206test script finished in 307.10s2207cleanup2208kill QemuMachine (pid 46)2209gitlab # [ 253.911605] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-09-04T06:44:39.980Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"b8a37a8ddf249d52f0bbffe5","created_at":"2026-09-04T06:44:39.427Z","trace_propagation_headers":{"sentry-trace":"c943ff43760f4bdd8ed0903e2c38ca46-80db69caebbd4452","baggage":"sentry-trace_id=c943ff43760f4bdd8ed0903e2c38ca46,sentry-release=Unknown"},"correlation_id":"01M1NJK2022MNH29NJRDTMNHWG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.428Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b8a37a8ddf249d52f0bbffe5: done: 0.268161 sec","job_status":"done","queue_duration_s":0.284023,"scheduling_latency_s":0.284041,"gitaly_calls":3,"gitaly_duration_s":0.123803,"redis_calls":68,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012055,"redis_read_bytes":149,"redis_write_bytes":18169,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000724,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001085,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":22,"redis_queues_duration_s":0.002408,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004582,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000523,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00042,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001589,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count"qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2210gitlab # :2211(finished: cleanup, in 1.41 seconds)2212additionally exposed symbols:2213 gitlab,2214 vlan1,2215 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2216[]2217[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-04T06:43:40.469Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2218[]2219[]2220[]2221[]2222[]2223[]2224[]2225[]2226[]2227[]2228[]2229[]2230[]2231[]2232[]2233[]2234[]2235[]2236[]2237[]2238[]2239[]2240[]2241[]2242[]2243[]2244[]2245[]2246[]2247[]2248[]2249[]2250[]2251[]2252[]2253[]2254[]2255[]2256[]2257[]2258[]2259[]2260[]2261[]2262[]2263[]2264[]2265[]2266[]2267[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '5802e58b9ea85d54624c49ab9ff40b06d35bfcee', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-04T06:44:32.697213Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2268[]2269[{'id': 5, 'sha': '5802e58b9ea85d54624c49ab9ff40b06d35bfcee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:44:34.381Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2270[{'id': 5, 'sha': '5802e58b9ea85d54624c49ab9ff40b06d35bfcee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:44:34.381Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2271[{'id': 5, 'sha': '5802e58b9ea85d54624c49ab9ff40b06d35bfcee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:44:34.381Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2272[{'id': 5, 'sha': '5802e58b9ea85d54624c49ab9ff40b06d35bfcee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:44:34.381Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2273[{'id': 5, 'sha': '5802e58b9ea85d54624c49ab9ff40b06d35bfcee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:44:34.381Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2274[{'id': 5, 'sha': '5802e58b9ea85d54624c49ab9ff40b06d35bfcee', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-09-04T06:44:34.381Z', 'started_at': None, 'finished_at': '2026-09-04T06:44:39.150Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '5802e58b9ea85d54624c49ab9ff40b06d35bfcee', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-04T06:44:39.289Z', 'started_at': None, 'finished_at': '2026-09-04T06:44:39.423Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]