vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #456
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.H8JCkvZX6N', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 46.35 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 6c210f2a-2cfb-42f3-8ea5-7452a715973819gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3askmf7k8f0v73bc5sfh3i919dh8q6hm-nixos-system-gitlab-test/init regInfo=/nix/store/r4nad4zlhg9dmc89qzbvpr3y97bf8nip-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 534659249 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000877] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002732] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002744] Using GB pages for direct mapping73gitlab # [ 0.002888] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002895] ACPI: Early table checksum verification disabled75gitlab # [ 0.002898] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002902] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002906] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002914] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002916] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002917] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002919] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002921] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002922] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002923] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002924] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002924] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002925] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002925] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003146] No NUMA configuration found90gitlab # [ 0.003147] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003150] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005403] Zone ranges:93gitlab # [ 0.005404] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005405] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005407] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005408] Device empty97gitlab # [ 0.005409] Movable zone start for each node98gitlab # [ 0.005409] Early memory node ranges99gitlab # [ 0.005410] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005411] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005412] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005413] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005433] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005703] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.111601] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.112031] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.112047] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.112083] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.112086] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.112088] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.112089] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.112090] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.112091] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.112093] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.112095] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.112099] TSC deadline timer available117gitlab # [ 0.112104] CPU topo: Max. logical packages: 1118gitlab # [ 0.112104] CPU topo: Max. logical dies: 1119gitlab # [ 0.112105] CPU topo: Max. dies per package: 1120gitlab # [ 0.112109] CPU topo: Max. threads per core: 1121gitlab # [ 0.112110] CPU topo: Num. cores per package: 4122gitlab # [ 0.112110] CPU topo: Num. threads per package: 4123gitlab # [ 0.112111] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.112136] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.112154] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.112156] kvm-guest: setup PV sched yield127gitlab # [ 0.112174] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.112175] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.112176] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.112178] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.112180] Booting paravirtualized kernel on KVM132gitlab # [ 0.112183] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.116666] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.118834] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.118886] kvm-guest: PV spinlocks enabled136gitlab # [ 0.118888] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.118891] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3askmf7k8f0v73bc5sfh3i919dh8q6hm-nixos-system-gitlab-test/init regInfo=/nix/store/r4nad4zlhg9dmc89qzbvpr3y97bf8nip-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.118989] Unknown kernel command line parameters "regInfo=/nix/store/r4nad4zlhg9dmc89qzbvpr3y97bf8nip-closure-info/registration", will be passed to user space.139gitlab # [ 0.119002] random: crng init done140gitlab # [ 0.119003] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.127637] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.131856] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.131929] software IO TLB: area num 4.144gitlab # [ 0.204649] Fallback order for Node 0: 0145gitlab # [ 0.204657] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.204659] Policy zone: Normal147gitlab # [ 0.207172] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.216895] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.230047] allocated 12582912 bytes of page_ext150gitlab # [ 0.240624] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.240626] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.241474] Dynamic Preempt: lazy153gitlab # [ 0.241625] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.241626] rcu: RCU event tracing is enabled.155gitlab # [ 0.241626] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.241628] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.241628] Rude variant of Tasks RCU enabled.158gitlab # [ 0.241629] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.241629] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.241630] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.241659] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.241661] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.241662] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.245990] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.246275] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.246284] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.246403] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.249991] Console: colour VGA+ 80x25169gitlab # [ 0.249993] printk: legacy console [tty0] enabled170gitlab # [ 0.280901] printk: legacy console [ttyS0] enabled171gitlab # [ 0.391439] ACPI: Core revision 20250807172gitlab # [ 0.392436] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.394062] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.395134] x2apic enabled175gitlab # [ 0.395901] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.396851] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.398167] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.399702] kvm-guest: setup PV IPIs179gitlab # [ 0.401311] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.402398] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.404232] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.405318] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.407229] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.409229] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.410233] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.412230] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.413230] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.414229] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.415228] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.416229] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.417238] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.418827] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.420230] active return thunk: srso_alias_return_thunk194gitlab # [ 0.421251] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.422229] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.423229] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.425063] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.426077] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.427229] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.428229] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.429230] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.430229] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.431229] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.433054] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.434049] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.435047] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.465662] Freeing SMP alternatives memory: 44K208gitlab # [ 0.466233] pid_max: default: 32768 minimum: 301209gitlab # [ 0.467338] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.468325] landlock: Up and running.211gitlab # [ 0.469230] Yama: becoming mindful.212gitlab # [ 0.470276] LSM support for eBPF active213gitlab # [ 0.471209] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.472378] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.475283] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.476801] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.477238] ... version: 2218gitlab # [ 0.478022] ... bit width: 48219gitlab # [ 0.478232] ... generic counters: 6220gitlab # [ 0.479006] ... generic bitmap: 000000000000003f221gitlab # [ 0.479232] ... fixed-purpose counters: 0222gitlab # [ 0.480019] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.480231] ... value mask: 0000ffffffffffff224gitlab # [ 0.481203] ... max period: 00007fffffffffff225gitlab # [ 0.482010] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.482351] signal: max sigframe size: 3376227gitlab # [ 0.483215] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.483907] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.484433] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.490031] smp: Bringing up secondary CPUs ...231gitlab # [ 0.491324] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.492236] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.495375] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.496984] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.497776] Memory: 6011608K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.499232] devtmpfs: initialized237gitlab # [ 0.500483] x86/mm: Memory block size: 128MB238gitlab # [ 0.504290] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.505310] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.506313] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.507539] PM: RTC time: 06:15:47, date: 2026-10-15242gitlab # [ 0.511163] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.513526] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.514298] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.516302] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.517243] audit: initializing netlink subsys (disabled)247gitlab # [ 0.518258] audit: type=2000 audit(1792044947.833:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.518486] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.520232] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.521232] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.522231] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.523231] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.524246] cpuidle: using governor menu254gitlab # [ 0.526477] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.527526] PCI: Using configuration type 1 for base access256gitlab # [ 0.528233] PCI: Using configuration type 1 for extended access257gitlab # [ 0.529400] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.532289] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.533234] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.534233] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.535232] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.539784] ACPI: Added _OSI(Module Device)263gitlab # [ 0.542239] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.544238] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.551136] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.558300] ACPI: Interpreter enabled267gitlab # [ 0.559306] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.561239] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.563278] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.567243] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.569586] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.583169] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.585246] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.587855] acpiphp: Slot [3] registered275gitlab # [ 0.589290] acpiphp: Slot [4] registered276gitlab # [ 0.591289] acpiphp: Slot [5] registered277gitlab # [ 0.592318] acpiphp: Slot [6] registered278gitlab # [ 0.594286] acpiphp: Slot [7] registered279gitlab # [ 0.595285] acpiphp: Slot [8] registered280gitlab # [ 0.596303] acpiphp: Slot [9] registered281gitlab # [ 0.598284] acpiphp: Slot [10] registered282gitlab # [ 0.599285] acpiphp: Slot [11] registered283gitlab # [ 0.601288] acpiphp: Slot [12] registered284gitlab # [ 0.602268] acpiphp: Slot [13] registered285gitlab # [ 0.603006] acpiphp: Slot [14] registered286gitlab # [ 0.603252] acpiphp: Slot [15] registered287gitlab # [ 0.604012] acpiphp: Slot [16] registered288gitlab # [ 0.605273] acpiphp: Slot [17] registered289gitlab # [ 0.606064] acpiphp: Slot [18] registered290gitlab # [ 0.606817] acpiphp: Slot [19] registered291gitlab # [ 0.607260] acpiphp: Slot [20] registered292gitlab # [ 0.608032] acpiphp: Slot [21] registered293gitlab # [ 0.609252] acpiphp: Slot [22] registered294gitlab # [ 0.609994] acpiphp: Slot [23] registered295gitlab # [ 0.610260] acpiphp: Slot [24] registered296gitlab # [ 0.611028] acpiphp: Slot [25] registered297gitlab # [ 0.612253] acpiphp: Slot [26] registered298gitlab # [ 0.612988] acpiphp: Slot [27] registered299gitlab # [ 0.613261] acpiphp: Slot [28] registered300gitlab # [ 0.614020] acpiphp: Slot [29] registered301gitlab # [ 0.615252] acpiphp: Slot [30] registered302gitlab # [ 0.615991] acpiphp: Slot [31] registered303gitlab # [ 0.616244] PCI host bridge to bus 0000:00304gitlab # [ 0.617001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.618184] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.619163] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.620232] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.622233] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.623232] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.624456] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.626690] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.628668] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.632250] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.633203] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.634145] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.635079] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.636155] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.637270] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.640285] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.642504] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.644511] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.645239] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.646451] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.659315] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.660246] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.661254] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.663420] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.665003] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.670267] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.671203] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.672197] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.684239] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.687643] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.699274] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.702255] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.704293] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.710357] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.721257] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.723253] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.726293] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.732317] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.739269] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.741248] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.743280] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.747928] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.760267] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.763255] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.765309] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.772558] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.783261] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.785254] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.788305] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.794454] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.804251] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.806249] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.807277] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.810249] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.814706] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.820316] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.822294] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.824716] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.829270] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.830213] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.832275] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.834546] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.838263] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.839200] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.840065] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.845544] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.847390] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.848370] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.849363] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.850312] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.853306] iommu: Default domain type: Translated375gitlab # [ 0.854235] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.855475] ACPI: bus type USB registered377gitlab # [ 0.856311] usbcore: registered new interface driver usbfs378gitlab # [ 0.857247] usbcore: registered new interface driver hub379gitlab # [ 0.858204] usbcore: registered new device driver usb380gitlab # [ 0.860213] NetLabel: Initializing381gitlab # [ 0.860695] NetLabel: domain hash size = 128382gitlab # [ 0.862232] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.863296] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.864242] PCI: Using ACPI for IRQ routing385gitlab # [ 0.865427] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.866228] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.866228] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.869238] vgaarb: loaded389gitlab # [ 0.869996] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.870232] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.874318] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.876003] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.876767] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.878318] pnp: PnP ACPI init395gitlab # [ 0.879479] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.889313] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.891018] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.892115] NET: Registered PF_INET protocol family399gitlab # [ 0.894294] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.912809] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.914414] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.915868] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.919738] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.921164] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.922726] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.924153] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.925674] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.927194] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.928227] NET: Registered PF_XDP protocol family410gitlab # [ 0.929108] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.930238] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.931325] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.932510] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.933695] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.935108] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.936164] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.938613] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.941258] PCI: CLS 0 bytes, default 64419gitlab # [ 0.942070] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.942682] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.943164] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.943287] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.966733] Initialise system trusted keyrings424gitlab # [ 0.968091] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.979547] Key type asymmetric registered426gitlab # [ 0.980340] Asymmetric key parser 'x509' registered427gitlab # [ 0.981276] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.983069] io scheduler mq-deadline registered429gitlab # [ 0.983876] io scheduler kyber registered430gitlab # [ 0.988686] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.990106] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.992671] Linux agpgart interface v0.103433gitlab # [ 0.993513] ACPI: bus type drm_connector registered434gitlab # [ 0.996732] usbcore: registered new interface driver usbserial_generic435gitlab # [ 0.997868] usbserial: USB Serial support registered for generic436gitlab # [ 0.998965] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 0.998965] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.001398] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.002852] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.004139] NET: Registered PF_INET6 protocol family441gitlab # [ 1.006152] Segment Routing with IPv6442gitlab # [ 1.006841] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.009530] IPI shorthand broadcast: enabled444gitlab # [ 1.014016] sched_clock: Marking stable (864015096, 149944767)->(1036881462, -22921599)445gitlab # [ 1.015911] registered taskstats version 1446gitlab # [ 1.017019] Loading compiled-in X.509 certificates447gitlab # [ 1.026649] Demotion targets for Node 0: null448gitlab # [ 1.027795] Key type .fscrypt registered449gitlab # [ 1.028555] Key type fscrypt-provisioning registered450gitlab # [ 1.029567] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.030565] ima: Allocated hash algorithm: sha1452gitlab # [ 1.031412] ima: No architecture policies found453gitlab # [ 1.032566] PM: Magic number: 14:505:266454gitlab # [ 1.034241] RAS: Correctable Errors collector initialized.455gitlab # [ 1.038783] clk: Disabling unused clocks456gitlab # [ 1.039582] PM: genpd: Disabling unused power domains457gitlab # [ 1.247286] Freeing initrd memory: 29392K458gitlab # [ 1.255468] Freeing unused decrypted memory: 2028K459gitlab # [ 1.262438] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.265528] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.271030] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.275303] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.345172] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.346308] Run /init as init process465gitlab # [ 1.359168] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.381931] fuse: init (API version 7.45)467gitlab # [ 1.390436] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.396894] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.400255] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.438388] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.775476] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.820604] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.823036] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.825425] systemd[1]: Running in initrd.475gitlab # [ 1.828310] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.831617] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.949202] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.993273] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.007725] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.008971] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.010459] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.011663] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.012819] systemd[1]: Reached target Path Units.484gitlab # [ 2.013754] systemd[1]: Reached target Slice Units.485gitlab # [ 2.014714] systemd[1]: Reached target Swaps.486gitlab # [ 2.015583] systemd[1]: Reached target Timer Units.487gitlab # [ 2.016653] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.017994] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.019181] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.020201] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.021267] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.022285] systemd[1]: Reached target Socket Units.493gitlab # [ 2.024287] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.026520] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.028624] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.031485] systemd[1]: Starting Journal Service...497gitlab # [ 2.034997] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.037178] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.041265] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.051149] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.055786] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.059608] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.063310] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config504gitlab # [ 2.068071] systemd-journald[90]: Collecting audit messages is disabled.505gitlab # [ 2.071619] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.089488] netfs: FS-Cache loaded507gitlab # [ 2.093243] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.508gitlab # [ 2.096475] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev509gitlab # [ 2.101068] 9pnet: Installing 9P2000 support510gitlab # [ 2.101423] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 2.105117] systemd[1]: Starting Apply Kernel Variables...512gitlab # [ 2.106458] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.513gitlab # [ 2.108305] systemd[1]: Finished Load Kernel Module 9pnet_virtio.514gitlab # [ 2.111564] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.515gitlab # [ 2.114408] systemd[1]: Starting Create Static Device Nodes in /dev...516gitlab # [ 2.119095] systemd[1]: Finished Apply Kernel Variables.517gitlab # [ 1.976334] systemd-modules-load[93]: Using 4 probe threads518gitlab # [ 2.126918] systemd[1]: Started Journal Service.519gitlab # [ 1.978433] systemd-modules-load[93]: Inserted module 'virtio_balloon'520gitlab # [ 1.979589] systemd-modules-load[93]: Inserted module 'dm_mod'521gitlab # [ 1.980720] systemd-modules-load[93]: Inserted module 'virtio_gpu'522gitlab # [ 1.982944] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.984924] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.985928] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.986760] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.987664] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.000020] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.010229] systemd-udevd[113]: Using default interface naming scheme 'v261'.529gitlab # [ 2.020742] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.054602] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.055562] systemd[1]: Reached target System Initialization.532gitlab # [ 2.056433] systemd[1]: Reached target Basic System.533gitlab # [ 2.283126] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.285013] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.286155] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.294284] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140537gitlab # [ 2.295688] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18538gitlab # [ 2.297557] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1539gitlab # [ 2.298709] usb usb1: Product: UHCI Host Controller540gitlab # [ 2.299458] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd541gitlab # [ 2.300359] usb usb1: SerialNumber: 0000:00:01.2542gitlab # [ 2.304653] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12543gitlab # [ 2.304997] SCSI subsystem initialized544gitlab # [ 2.307147] serio: i8042 KBD port at 0x60,0x64 irq 1545gitlab # [ 2.307888] serio: i8042 AUX port at 0x60,0x64 irq 12546gitlab # [ 2.325679] hub 1-0:1.0: USB hub found547gitlab # [ 2.326675] hub 1-0:1.0: 2 ports detected548gitlab # [ 2.332629] virtio_blk virtio4: 4/0/0 default/read/poll queues549gitlab # [ 2.357177] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)550gitlab # [ 2.215925] systemd[1]: Starting Virtual Console Setup...551gitlab # [ 2.368644] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0552gitlab # [ 2.368651] virtio_blk virtio5: 4/0/0 default/read/poll queues553gitlab # [ 2.372016] scsi host0: ata_piix554gitlab # [ 2.222308] (udev-worker)[118]: Network interface NamePolicy= disabled on kernel command line.555gitlab # [ 2.224323] (udev-worker)[128]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.556gitlab # [ 2.376074] virtio_blk virtio5: [vdb] 11953232 512-byte logical blocks (6.12 GB/5.70 GiB)557gitlab # [ 2.228957] (udev-worker)[128[ 2.378384] scsi host1: ata_piix558gitlab # ]: Network inter[ 2.378576] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0559gitlab # face NamePolicy= disabled on kernel command line.560gitlab # [ 2.381781] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0561gitlab # [ 2.239819] systemd-vconsole-setup[144]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.243245] systemd[1]: Finished Virtual Console Setup.563gitlab # [ 2.247592] systemd[1]: Found device /dev/disk/by-label/nixos.564gitlab # [ 2.248487] systemd[1]: Reached target Initrd Root Device.565gitlab # [ 2.250104] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...566gitlab # [ 2.253170] systemd[1]: Found device /dev/disk/by-label/nix-store.567gitlab # [ 2.271374] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.274992] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.540624] ata2: found unknown device (class 0)570gitlab # [ 2.542064] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571gitlab # [ 2.545853] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572gitlab # [ 2.556052] usb 1-1: new full-speed USB device number 2 using uhci_hcd573gitlab # [ 2.600387] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.627844] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.725287] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.728338] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.731021] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.732651] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.734159] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.772022] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.787680] usbcore: registered new interface driver usbhid582gitlab # [ 2.790525] usbhid: USB HID core driver583gitlab # [ 2.801419] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.806065] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.896486] systemd[1]: Mounting /sysroot...586gitlab # [ 3.200611] EXT4-fs (vda): mounted filesystem 6c210f2a-2cfb-42f3-8ea5-7452a7159738 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.056720] systemd[1]: Mounted /sysroot.588gitlab # [ 3.057679] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.060588] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.062291] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.064645] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.065733] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.077278] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.080130] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.086808] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.242107] 9p: Installing v9fs 9p2000 file system support597gitlab # [ 3.096586] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload.598gitlab # [ 3.098270] systemd[1]: Starting rw-sysroot-nix-store.service...599gitlab # [ 3.100139] systemd[1]: Mounted /sysroot/run.600gitlab # [ 3.101939] systemd[1]: Mounted /sysroot/tmp/shared.601gitlab # [ 3.107936] systemd[1]: Mounted /sysroot/tmp/xchg.602gitlab # [ 3.109481] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.603gitlab # [ 3.110734] systemd[1]: Finished rw-sysroot-nix-store.service.604gitlab # [ 3.260167] erofs (device vdb): mounted with root inode @ nid 128.605gitlab # [ 3.111732] systemd[1]: Reload requested from client PID 177 ('systemd-sysroot') (unit initrd-parse-etc.service)...606gitlab # [ 3.114975] systemd[1]: Reloading...607gitlab # [ 3.168770] systemd[1]: Reloading finished in 57 ms.608gitlab # [ 3.191222] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace...609gitlab # [ 3.194402] systemd[1]: Mounted /sysroot/nix/.ro-store.610gitlab # [ 3.196658] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace...611gitlab # [ 3.199797] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.202281] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.204994] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.207859] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.216201] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.219259] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.896984] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.950302] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.952238] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.954190] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.955980] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.976787] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.979631] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.999601] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.001430] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.003418] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.032647] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.034656] systemd[1]: Stopped target Basic System.629gitlab # [ 4.036442] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.038288] systemd[1]: Stopped target Path Units.631gitlab # [ 4.039994] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.042552] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.048155] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.050087] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.053869] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.056836] systemd[1]: Stopped target Swaps.637gitlab # [ 4.058626] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.061443] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.063812] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.065891] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.068404] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.070094] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.073638] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.075560] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.077642] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.079115] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.081065] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.082458] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.084525] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.086549] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.088447] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.090109] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.091562] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.093325] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.095188] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.096336] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.097705] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.098841] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.099649] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.100685] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.101666] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.102727] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.103652] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.104539] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.105502] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.106476] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.107167] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.107914] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.108921] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.109741] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.110818] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.111773] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.112727] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.116925] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.117997] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.119172] systemd[1]: Reached target Switch Root.677gitlab # [ 4.121213] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.237974] initrd-nixos-activation-start[226]: booting system configuration /nix/store/3askmf7k8f0v73bc5sfh3i919dh8q6hm-nixos-system-gitlab-test679gitlab # [ 4.270775] initrd-nixos-activation-start[226]: running activation script...680gitlab # [ 4.488559] initrd-nixos-activation-start[249]: setting up /etc...681gitlab # [ 4.602345] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.603765] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.605830] systemd[1]: Starting Switch Root...684gitlab # [ 4.626418] systemd[1]: Switching root.685gitlab # [ 4.832197] systemd-journald[90]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.936814] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.302695] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.309806] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.311706] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.313695] systemd[1]: Detected first boot.691gitlab # [ 5.316289] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.455551] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.542157] systemd[1]: Applying preset policy.694gitlab # [ 5.661721] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.779774] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.781196] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.783492] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.785788] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.787241] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.788678] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.789634] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.790899] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.792111] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.792846] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.793658] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.794536] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.795415] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.796312] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.797223] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.798183] systemd[1]: Reached target Path Units.711gitlab # [ 5.798918] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.799785] systemd[1]: Reached target Slice Units.713gitlab # [ 5.800541] systemd[1]: Reached target Swaps.714gitlab # [ 5.802021] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.804095] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.805509] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.807168] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.808125] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.810456] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.811900] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.813826] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.815015] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.816155] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.817538] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.820342] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.821424] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.822356] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.825404] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.827488] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.829798] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.833031] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.841381] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.842646] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.847018] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.849458] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.853080] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.857113] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.894209] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.895333] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.902010] systemd[1]: Starting Journal Service...741gitlab # [ 5.904028] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.906345] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.908826] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.910861] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 5.921502] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 5.925836] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 5.926829] systemd[1]: Mounted Huge Pages File System.748gitlab # [ 5.927926] systemd[1]: Mounted POSIX Message Queue File System.749gitlab # [ 5.928995] systemd[1]: Mounted Kernel Debug File System.750gitlab # [ 5.930016] systemd[1]: Mounted Kernel Trace File System.751gitlab # [ 5.931317] systemd[1]: Finished Create List of Static Device Nodes.752gitlab # [ 5.932598] systemd[1]: modprobe@configfs.service: Deactivated successfully.753gitlab # [ 5.936063] systemd[1]: Finished Load Kernel Module configfs.754gitlab # [ 5.937187] systemd[1]: Mounted FUSE Control File System.755gitlab # [ 5.940012] EXT4-fs (vda): re-mounted 6c210f2a-2cfb-42f3-8ea5-7452a7159738.756gitlab # [ 5.942053] systemd[1]: Mounting Kernel Configuration File System...757gitlab # [ 5.943700] systemd-journald[320]: Collecting audit messages is enabled.758gitlab # [ 5.951546] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...759gitlab # [ 5.953741] loop: module loaded760gitlab # [ 5.956488] systemd[1]: Finished Remount Root and Kernel File Systems.761gitlab # [ 5.958227] systemd[1]: Finished Load Kernel Modules.762gitlab # [ 5.959155] systemd[1]: Mounted Kernel Configuration File System.763gitlab # [ 5.960304] systemd[1]: Listening on Disk Image Download Service Socket.764gitlab # [ 5.962390] systemd[1]: Starting Firewall...765gitlab # [ 5.963234] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore766gitlab # [ 5.812896] systemd[1]: Queued start job for default target Multi-User System.767gitlab # [ 5.816233] systemd[1]: Unnecessary job was removed for /dev/vdb.768gitlab # [ 5.817371] systemd[1]: systemd-journald.service: Deactivated successfully.769gitlab # [ 5.818613] systemd-modules-load[321]: Using 3 probe threads770gitlab # [ 5.819670] systemd-modules-load[321]: Inserted module 'tls'771gitlab # [ 5.820685] systemd-modules-load[321]: Inserted module 'loop'772gitlab # [ 5.821857] systemd-oomd[322]: No swap; memory pressure usage will be degraded773gitlab # [ 5.974365] systemd[1]: Starting Load/Save OS Random Seed...774gitlab # [ 5.976644] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 5.977581] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os776gitlab # [ 5.979988] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.777gitlab # [ 5.981141] systemd[1]: Started Journal Service.778gitlab # [ 5.841386] systemd[1]: Starting Flush Journal to Persistent Storage...779gitlab # [ 5.844069] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.780gitlab # [ 5.852116] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 5.854488] systemd[1]: Finished Apply Kernel Variables.782gitlab # [ 5.857269] systemd[1]: Reached target First Boot Complete.783gitlab # [ 5.859160] systemd[1]: Starting Create Static Device Nodes in /dev...784gitlab # [ 6.010283] systemd-journald[320]: Received client request to flush runtime journal.785gitlab # [ 5.894434] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 5.895944] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 5.897791] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 5.899132] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 5.906832] systemd-udevd[356]: Using default interface naming scheme 'v261'.790gitlab # [ 5.923966] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 5.934674] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.002420] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.031541] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.062148] (udev-worker)[427]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.795gitlab # [ 6.064357] (udev-worker)[427]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.095790] (udev-worker)[424]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 6.119176] systemd[1]: Condition check resulted in Virtio network device being skipped.798gitlab # [ 6.122098] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.799gitlab # [ 6.285818] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3800gitlab # [ 6.294479] Floppy drive(s): fd0 is 2.88M AMI BIOS801gitlab # [ 6.295602] ACPI: button: Power Button [PWRF]802gitlab # [ 6.303371] rtc_cmos 00:05: RTC can wake from S4803gitlab # [ 6.305497] rtc_cmos 00:05: registered as rtc0804gitlab # [ 6.306559] FDC 0 is a S82078B805gitlab # [ 6.307268] rtc_cmos 00:05: setting system clock to 2026-10-15T06:15:52 UTC (1792044952)806gitlab # [ 6.308821] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs807gitlab # [ 6.315357] systemd-journald[320]: Time jumped backwards, rotating.808gitlab # [ 6.318070] parport_pc 00:03: reported by Plug and Play ACPI809gitlab # [ 6.319836] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]810gitlab # [ 6.322672] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0811gitlab # [ 6.324083] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD812gitlab # [ 6.330183] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console813gitlab # [ 6.349159] Console: switching to colour dummy device 80x25814gitlab # [ 6.349852] [drm] Found bochs VGA, ID 0xb0c5.815gitlab # [ 6.350857] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.816gitlab # [ 6.354525] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic817gitlab # [ 6.355326] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0818gitlab # [ 6.363657] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4819gitlab # [ 6.376399] Console: switching to colour frame buffer device 160x50820gitlab # [ 6.378417] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device821gitlab # [ 6.381962] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6822gitlab # [ 6.267242] systemd[1]: Finished Firewall.823gitlab # [ 6.282508] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore824gitlab # [ 6.284569] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67825gitlab # [ 6.286792] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore826gitlab # [ 6.288358] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os827gitlab # [ 6.289806] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os828gitlab # [ 6.451347] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5829gitlab # [ 6.312838] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 6.476470] ppdev: user-space parallel port driver831gitlab # [ 6.333069] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.338107] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.362121] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.517702] kvm_amd: TSC scaling supported835gitlab # [ 6.368409] systemd[1]: systemd-vconsole-setup.service: Deact[ 6.518982] kvm_amd: Nested Virtualization enabled836gitlab # ivated successfu[ 6.519624] kvm_amd: Nested Paging enabled837gitlab # lly.838gitlab # [ 6.520293] kvm_amd: LBR virtualization supported839gitlab # [ 6.520771] kvm_amd: Virtual VMLOAD VMSAVE supported840gitlab # [ 6.371223] s[ 6.521474] kvm_amd: Virtual GIF supported841gitlab # ystemd[1]: Stopp[ 6.522170] kvm_amd: Virtual NMI enabled842gitlab # ed Virtual Console Setup.843gitlab # [ 6.530025] mousedev: PS/2 mouse device common for all mice844gitlab # [ 6.385077] systemd[1]: Starting Virtual Console Setup...845gitlab # [ 6.561775] EDAC MC: Ver: 3.0.0846gitlab # [ 6.442970] systemd-vconsole-setup[493]: Configuration of first virtual console was skipped, ignoring remaining ones.847gitlab # [ 6.445640] systemd[1]: Finished Virtual Console Setup.848gitlab # [ 6.634814] systemd[1]: Mounting /run/wrappers...849gitlab # [ 6.660057] systemd[1]: Mounted /run/wrappers.850gitlab # [ 6.662053] systemd[1]: Reached target Local File Systems.851gitlab # [ 6.663956] systemd[1]: Listening on Boot Loader Control Service Socket.852gitlab # [ 6.666460] systemd[1]: Starting register-nix-paths.service...853gitlab # [ 6.668805] systemd[1]: Starting Create SUID/SGID Wrappers...854gitlab # [ 6.672245] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.855gitlab # [ 6.675360] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 6.678370] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 6.721911] systemd[1]: Finished Create System Files and Directories.858gitlab # [ 6.726550] systemd[1]: Starting Rebuild Journal Catalog...859gitlab # [ 6.728490] systemd[1]: Starting Record System Boot/Shutdown in UTMP...860gitlab # [ 6.733310] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.861gitlab # [ 6.740923] systemd[1]: Finished Save Transient machine-id to Disk.862gitlab # [ 6.747241] systemd[1]: Finished Record System Boot/Shutdown in UTMP.863gitlab # [ 6.765355] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 6.767121] systemd[1]: Starting Update is Completed...865gitlab # [ 6.780386] systemd[1]: Finished Update is Completed.866gitlab # [ 6.841814] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 6.843978] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 7.070271] systemd[1]: Finished register-nix-paths.service.869gitlab # [ 7.072586] systemd[1]: Reached target System Initialization.870gitlab # [ 7.074716] systemd[1]: Started Discard unused filesystem blocks once a week.871gitlab # [ 7.077306] systemd[1]: Started logrotate.timer.872gitlab # [ 7.079340] systemd[1]: Started Daily Cleanup of Temporary Directories.873gitlab # [ 7.081764] systemd[1]: Reached target Timer Units.874gitlab # [ 7.083754] systemd[1]: Listening on D-Bus System Message Bus Socket.875gitlab # [ 7.086149] systemd[1]: Listening on Nix Daemon Socket.876gitlab # [ 7.088158] systemd[1]: Starting nixbot CI service socket...877gitlab # [ 7.090257] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.878gitlab # [ 7.093223] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 7.095479] systemd[1]: Reached target Socket Units.880gitlab # [ 7.097772] systemd[1]: Starting D-Bus System Message Bus...881gitlab # [ 7.126672] dbus-broker-launch[575]: Looking up NSS user entry for 'systemd-timesync'...882gitlab # [ 7.130431] dbus-broker-launch[575]: NSS returned no entry for 'systemd-timesync'883gitlab # [ 7.133254] dbus-broker-launch[575]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"884gitlab # [ 7.138853] systemd[1]: Started D-Bus System Message Bus.885gitlab # [ 7.146601] dbus-broker-launch[575]: Ready886gitlab # [ 7.148408] systemd[1]: Reached target Basic System.887gitlab # [ 7.151305] systemd[1]: Started backdoor.service.888gitlab # [ 7.153876] systemd[1]: Starting gitlab-config.service...889gitlab # [ 7.158719] systemd[1]: Starting Import lastlog data into lastlog2 database...890gitlab # [ 7.161447] systemd[1]: Starting Logrotate configuration check...891gitlab # [ 7.173581] systemd[1]: Starting Name Service Cache Daemon (nsncd)...892gitlab # [ 7.177686] systemd[1]: Starting Post-Boot Actions...893gitlab # [ 7.186391] systemd[1]: Started Reset console on configuration changes.894gitlab # [ 7.189926] logrotate[580]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.895gitlab # [ 7.193855] logrotate[580]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf896gitlab # [ 7.200132] logrotate[580]: note: 'monthly' overrides previously specified 'weekly'897gitlab # [ 7.202127] systemd[1]: Starting resolvconf update...898gitlab # connecting to host...899gitlab # [ 7.203590] logrotate[580]: Reading state from file: /var/lib/logrotate.status900gitlab # [ 7.204210] logrotate[580]: state file /var/lib/logrotate.status does not exist901gitlab # [ 7.205197] logrotate[580]: Allocating hash table for state file, size 64 entries902gitlab # [ 7.206157] logrotate[580]: Handling 4 logs903gitlab # [ 7.207066] logrotate[580]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed904gitlab # [ 7.208055] logrotate[580]: considering log /var/log/btmp905gitlab # [ 7.208917] logrotate[580]: Creating new state906gitlab # [ 7.209681] logrotate[580]: Now: 2026-10-15 06:15907gitlab # [ 7.210571] logrotate[580]: Last rotated at 2026-10-15 06:00908gitlab # [ 7.211091] logrotate[580]: log does not need rotating (log has already been rotated)909gitlab # [ 7.211243] logrotate[580]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed910gitlab # [ 7.211784] logrotate[580]: considering log /var/log/wtmp911gitlab # [ 7.215079] logrotate[580]: Creating new state912gitlab # [ 7.215807] logrotate[580]: Now: 2026-10-15 06:15913gitlab # [ 7.216664] logrotate[580]: Last rotated at 2026-10-15 06:00914gitlab # [ 7.217447] logrotate[580]: log does not need rotating (log has already been rotated)915gitlab # [ 7.217972] logrotate[580]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed916gitlab # [ 7.218695] logrotate[580]: switching euid from 0 to 165 and egid from 0 to 165 (pid 580)917gitlab # [ 7.219495] logrotate[580]: considering log /var/gitlab/state/log/*.log918gitlab # [ 7.219875] logrotate[580]: log /var/gitlab/state/log/*.log does not exist -- skipping919gitlab # [ 7.220548] logrotate[580]: Creating new state920gitlab # [ 7.221067] logrotate[580]: switching euid from 165 to 0 and egid from 165 to 0 (pid 580)921gitlab # [ 7.221556] logrotate[580]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed922gitlab # [ 7.222485] logrotate[580]: switching euid from 0 to 60 and egid from 0 to 60 (pid 580)923gitlab # [ 7.223630] logrotate[580]: considering log /var/log/nginx/*.log924gitlab # [ 7.225203] logrotate[580]: log /var/log/nginx/*.log does not exist -- skipping925gitlab # [ 7.225857] logrotate[580]: Creating new state926gitlab # [ 7.229047] logrotate[580]: not running postrotate script, since no logs were rotated927gitlab # [ 7.229736] logrotate[580]: switching euid from 60 to 0 and egid from 60 to 0 (pid 580)928gitlab # [ 7.230455] systemd[1]: Finished Logrotate configuration check.929gitlab: Guest shell says: b'Spawning backdoor root shell...\n'930gitlab # [ 7.234759] nsncd[581]: Oct 15 06:15:53.577 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"931gitlab # [ 7.236760] systemd[1]: Started Name Service Cache Daemon (nsncd).932gitlab: connected to guest root shell933gitlab # [ 7.238223] systemd[1]: Finished Import lastlog data into lastlog2 database.934gitlab: (connecting took 7.93 seconds)935gitlab # [ 7.241560] systemd[1]: Reached target Host and Network Name Lookups.936gitlab: (finished: waiting for the VM to finish booting, in 7.93 seconds)937gitlab # [ 7.241723] systemd[1]: Reached target User and Group Name Lookups.938gitlab # [ 7.244895] systemd[1]: Starting User Login Management...939gitlab # [ 7.245661] systemd[1]: Finished Post-Boot Actions.940gitlab # [ 7.288525] systemd-logind[610]: New seat seat0.941gitlab # [ 7.288769] systemd[1]: Stopped target Host and Network Name Lookups.942gitlab # [ 7.289508] systemd[1]: Stopping Host and Network Name Lookups...943gitlab # [ 7.292073] systemd[1]: Stopped target User and Group Name Lookups.944gitlab # [ 7.293741] systemd[1]: Stopping User and Group Name Lookups...945gitlab # [ 7.294280] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...946gitlab # [ 7.294598] systemd[1]: nscd.service: Deactivated successfully.947gitlab # [ 7.295165] systemd[1]: Stopped Name Service Cache Daemon (nsncd).948gitlab # [ 7.295655] systemd[1]: nscd.service: Consumed 20ms CPU time over 118ms wall clock time, 7.5M memory peak, 5.5M read from disk.949gitlab # [ 7.296447] systemd-logind[610]: Watching system buttons on /dev/input/event2 (Power Button)950gitlab # [ 7.297820] systemd-logind[610]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)951gitlab # [ 7.298801] systemd-logind[610]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)952gitlab # [ 7.303924] systemd[1]: Started User Login Management.953gitlab # [ 7.307862] systemd[1]: Starting linger-users.service...954gitlab # [ 7.309508] systemd[1]: Starting Name Service Cache Daemon (nsncd)...955gitlab # [ 7.324699] systemd[1]: Finished resolvconf update.956gitlab # [ 7.326968] systemd[1]: linger-users.service: Deactivated successfully.957gitlab # [ 7.327653] systemd[1]: Finished linger-users.service.958gitlab # [ 7.328300] nsncd[676]: Oct 15 06:15:53.670 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"959gitlab # [ 7.328589] systemd[1]: Started Name Service Cache Daemon (nsncd).960gitlab # [ 7.329099] systemd[1]: Reached target Preparation for Network.961gitlab # [ 7.329622] systemd[1]: Reached target Host and Network Name Lookups.962gitlab # [ 7.330141] systemd[1]: Reached target User and Group Name Lookups.963gitlab # [ 7.331672] systemd[1]: Starting DHCP Client...964gitlab # [ 7.335204] systemd[1]: Starting Address configuration of eth1...965gitlab # [ 7.336338] systemd[1]: Starting Extra networking commands....966gitlab # [ 7.370452] network-addresses-eth1-start[698]: adding address 192.168.1.1/24... done967gitlab # [ 7.374225] network-addresses-eth1-start[698]: adding address 2001:db8:1::1/64... done968gitlab # [ 7.381563] systemd[1]: Finished Address configuration of eth1.969gitlab # [ 7.407886] systemd[1]: Finished Extra networking commands..970gitlab # [ 7.409096] systemd[1]: Reached target Network.971gitlab # [ 7.411379] dhcpcd[706]: dhcpcd-10.3.2 starting972gitlab # [ 7.411898] systemd[1]: Starting gitlab-workhorse.service...973gitlab # [ 7.413637] systemd[1]: Starting Nginx Web Server...974gitlab # [ 7.415444] dhcpcd[765]: dev: loaded udev975gitlab # [ 7.416188] systemd[1]: Starting PostgreSQL Server...976gitlab # [ 7.421346] systemd[1]: Starting Redis Server - redis-gitlab...977gitlab # [ 7.423126] systemd[1]: Starting Permit User Sessions...978gitlab # [ 7.573069] 8021q: 802.1Q VLAN Support v1.8979gitlab # [ 7.574443] 8021q: adding VLAN 0 to HW filter on device eth1980gitlab # [ 7.438656] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.981gitlab # [ 7.448713] systemd[1]: Finished Permit User Sessions.982gitlab # [ 7.451290] systemd[1]: Started Getty on tty1.983gitlab # [ 7.452886] systemd[1]: Reached target Login Prompts.984gitlab # [ 7.662547] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 7.670154] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 7.671195] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 7.672493] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 7.673459] cfg80211: failed to load regulatory.db989gitlab # [ 7.531040] nginx-pre-start[789]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok990gitlab # [ 7.531621] nginx-pre-start[789]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful991gitlab # [ 7.539984] systemd[1]: Started Nginx Web Server.992gitlab # [ 7.705180] 8021q: adding VLAN 0 to HW filter on device eth0993gitlab # [ 7.556652] dhcpcd[765]: eth0: waiting for carrier994gitlab # [ 7.557097] dhcpcd[765]: eth0: carrier acquired995gitlab # [ 7.563208] dhcpcd[765]: DUID 00:01:00:01:32:63:2c:19:52:54:00:12:34:56996gitlab # [ 7.563899] dhcpcd[765]: eth0: IAID 00:12:34:56997gitlab # [ 7.564742] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:3456998gitlab # [ 7.567564] redis-server[787]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.999gitlab # [ 7.567956] redis-server[787]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1000gitlab # [ 7.568659] redis-server[787]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=787, just started1001gitlab # [ 7.569173] redis-server[787]: Configuration loaded1002gitlab # [ 7.569889] redis[787]: monotonic clock: POSIX clock_gettime1003gitlab # [ 7.570978] redis[787]: Running mode=standalone, port=0.1004gitlab # [ 7.573864] systemd[1]: Started Redis Server - redis-gitlab.1005gitlab # [ 7.574693] redis[787]: Server initialized1006gitlab # [ 7.575256] redis[787]: Ready to accept connections unix1007gitlab # [ 7.575703] redis[787]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1008gitlab # [ 7.579885] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres".1009gitlab # [ 7.580277] postgresql-pre-start[791]: This user must also own the server process.1010gitlab # [ 7.583093] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8".1011gitlab # [ 7.583615] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8".1012gitlab # [ 7.584071] postgresql-pre-start[791]: The default text search configuration will be set to "english".1013gitlab # [ 7.584607] postgresql-pre-start[791]: Data page checksums are enabled.1014gitlab # [ 7.585225] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1015gitlab # [ 7.585676] postgresql-pre-start[791]: creating subdirectories ... ok1016gitlab # [ 7.586232] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix1017gitlab # [ 7.611478] postgresql-pre-start[791]: selecting default "max_connections" ... 1001018gitlab # [ 7.645437] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB1019gitlab # [ 7.950102] systemd[1]: Started gitlab-workhorse.service.1020gitlab # [ 8.017833] postgresql-pre-start[791]: selecting default time zone ... UTC1021gitlab # [ 8.020264] postgresql-pre-start[791]: creating configuration files ... ok1022gitlab # [ 8.145863] gitlab-workhorse[824]: time="2026-10-15T06:15:54Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41023gitlab # [ 8.147645] gitlab-workhorse[824]: time="2026-10-15T06:15:54Z" level=info msg="Using redis/go-redis"1024gitlab # [ 8.149019] gitlab-workhorse[824]: time="2026-10-15T06:15:54Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1025gitlab # [ 8.175129] postgresql-pre-start[791]: running bootstrap script ... ok1026gitlab # [ 8.622337] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok1027gitlab # [ 8.928096] postgresql-pre-start[791]: syncing data to disk ... ok1028gitlab # [ 8.928464] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections1029gitlab # [ 8.930121] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1030gitlab # [ 8.931288] postgresql-pre-start[791]: Success. You can now start the database server using:1031gitlab # [ 8.932521] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1032gitlab # [ 8.993204] dhcpcd[765]: eth0: soliciting a DHCP lease1033gitlab # [ 9.150475] NET: Registered PF_PACKET protocol family1034gitlab # [ 9.009837] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.21035gitlab # [ 9.015239] dhcpcd[765]: eth0: probing address 10.0.2.15/241036gitlab # [ 9.061236] postgres[849]: [849] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1037gitlab # [ 9.061863] postgres[849]: [849] LOG: listening on IPv6 address "::1", port 54321038gitlab # [ 9.062752] postgres[849]: [849] LOG: listening on IPv4 address "127.0.0.1", port 54321039gitlab # [ 9.066369] postgres[849]: [849] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1040gitlab # [ 9.077127] postgres[860]: [860] LOG: database system was shut down at 2026-10-15 06:15:54 GMT1041gitlab # [ 9.084687] postgres[849]: [849] LOG: database system is ready to accept connections1042gitlab # [ 9.089507] systemd[1]: Started PostgreSQL Server.1043gitlab # [ 9.092297] systemd[1]: Starting PostgreSQL Setup Scripts...1044gitlab # [ 9.226908] postgresql-setup-start[875]: CREATE DATABASE1045gitlab # [ 9.252697] postgresql-setup-start[881]: CREATE ROLE1046gitlab # [ 9.265425] postgresql-setup-start[883]: ALTER DATABASE1047gitlab # [ 9.283924] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[870]: mkdir -p /var/gitlab/state/home/.ssh: OK1048gitlab # [ 9.285649] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[870]: chmod 700 /var/gitlab/state/home/.ssh: OK1049gitlab # [ 9.295221] postgresql-setup-start[888]: CREATE ROLE1050gitlab # [ 9.296845] systemd[1]: Finished PostgreSQL Setup Scripts.1051gitlab # [ 9.297930] systemd[1]: Reached target PostgreSQL.1052gitlab # [ 9.300434] systemd[1]: Starting gitlab-postgresql.service...1053gitlab # [ 9.330805] systemd[1]: Finished gitlab-config.service.1054gitlab # [ 9.333197] systemd[1]: Started gitaly.service.1055gitlab # [ 9.335434] systemd[1]: Starting gitlab-db-config.service...1056gitlab # [ 9.393023] gitlab-postgresql-start[913]: CREATE DATABASE1057gitlab # [ 9.426235] gitlab-postgresql-start[926]: CREATE EXTENSION1058gitlab # [ 9.473376] dhcpcd[765]: eth0: soliciting an IPv6 router1059gitlab # [ 9.475219] dhcpcd[765]: eth0: Router Advertisement from fe80::21060gitlab # [ 9.475534] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/641061gitlab # [ 9.476650] dhcpcd[765]: eth0: adding route to fec0::/641062gitlab # [ 9.477997] dhcpcd[765]: eth0: adding default route via fe80::21063gitlab # [ 9.509295] gitlab-postgresql-start[928]: CREATE EXTENSION1064gitlab # [ 9.514286] systemd[1]: Finished gitlab-postgresql.service.1065gitlab # [ 9.829880] gitaly[912]: time="2026-10-15T06:15:56.171Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9121066gitlab # [ 9.830795] gitaly[912]: time="2026-10-15T06:15:56.171Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9121067gitlab # [ 9.831792] gitaly[912]: time="2026-10-15T06:15:56.171Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9121068gitlab # [ 9.836545] gitaly[912]: time="2026-10-15T06:15:56.171Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9121069gitlab # [ 9.837120] gitaly[912]: time="2026-10-15T06:15:56.171Z" level=info msg="Starting Gitaly" pid=912 version=1070gitlab # [ 10.013210] gitaly[912]: time="2026-10-15T06:15:56.355Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=183 pid=9121071gitlab # [ 10.013450] gitaly[912]: time="2026-10-15T06:15:56.355Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9121072gitlab # [ 10.013871] gitaly[912]: time="2026-10-15T06:15:56.356Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9121073gitlab # [ 10.014552] gitaly[912]: time="2026-10-15T06:15:56.356Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-912/git-exec-3779360657.d/git pid=9121074gitlab # [ 10.018213] gitaly[912]: time="2026-10-15T06:15:56.360Z" level=info msg="finished detecting git version" duration_ms=4 pid=9121075gitlab # [ 10.018878] gitaly[912]: time="2026-10-15T06:15:56.360Z" level=info msg="using Git version" pid=912 version=2.53.g1076gitlab # [ 10.019586] gitaly[912]: time="2026-10-15T06:15:56.361Z" level=info msg="clearing disk cache object folder" pid=912 storage=default1077gitlab # [ 10.020207] gitaly[912]: time="2026-10-15T06:15:56.361Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2546522118 pid=912 storage=default1078gitlab # [ 10.020409] gitaly[912]: time="2026-10-15T06:15:56.361Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2546522118 pid=912 storage=default1079gitlab # [ 10.021051] gitaly[912]: time="2026-10-15T06:15:56.361Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9121080gitlab # [ 10.021630] gitaly[912]: time="2026-10-15T06:15:56.361Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9121081gitlab # [ 10.022405] gitaly[912]: time="2026-10-15T06:15:56.361Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2546522118 clear_duration_ms=0 pid=912 storage=default1082gitlab # [ 10.073521] gitaly[912]: time="2026-10-15T06:15:56.416Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9121083gitlab # [ 10.073924] gitaly[912]: time="2026-10-15T06:15:56.416Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=912 schema=unix1084gitlab # [ 10.078050] gitaly[912]: time="2026-10-15T06:15:56.417Z" level=info msg="finished tempdir cleaner walk" pid=912 storage=default time_ms=01085gitlab # [ 10.078375] gitaly[912]: time="2026-10-15T06:15:56.416Z" level=info msg="counting repositories" pid=9121086gitlab # [ 10.078960] gitaly[912]: time="2026-10-15T06:15:56.417Z" level=info msg="starting to count repositories" pid=912 storage_path=/var/gitlab/state/repositories1087gitlab # [ 10.079822] gitaly[912]: time="2026-10-15T06:15:56.420Z" level=info msg="listening at address" address=/run/gitaly/gitaly-912/sock.d/intern pid=912 schema=unix1088gitlab # [ 10.080570] gitaly[912]: time="2026-10-15T06:15:56.422Z" level=info msg="completed counting repositories" counting_duration_ms=4 pid=912 storage_path=/var/gitlab/state/repositories1089gitlab # [ 10.081203] gitaly[912]: time="2026-10-15T06:15:56.422Z" level=info msg="completed counting all repositories" counting_duration=4 pid=9121090gitlab # [ 10.090714] gitaly[912]: time="2026-10-15T06:15:56.433Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9121091gitlab # [ 10.092367] gitaly[912]: time="2026-10-15T06:15:56.433Z" level=info msg="Started Gitaly" duration_ms=261 pid=9121092gitlab # [ 10.093927] gitaly[912]: time="2026-10-15T06:15:56.433Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9121093gitlab # [ 10.095931] gitaly[912]: time="2026-10-15T06:15:56.433Z" level=info msg="maintenance: daily scheduled" pid=912 scheduled="2026-10-15 12:00:00 +0000 UTC"1094gitlab # [ 10.590924] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1095gitlab # [ 10.591773] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1096gitlab # [ 10.614653] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1097gitlab # [ 12.109590] gitaly[912]: time="2026-10-15T06:15:58.451Z" level=info msg="License database preloaded" duration_ms=2279 pid=9121098gitlab # [ 14.004113] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds1099gitlab # [ 14.006458] dhcpcd[765]: eth0: adding route to 10.0.2.0/241100gitlab # [ 14.008384] dhcpcd[765]: eth0: adding default route via 10.0.2.21101gitlab # [ 14.094133] systemd[1]: Started DHCP Client.1102gitlab # [ 14.096987] systemd[1]: Reached target Network is Online.1103gitlab # [ 40.068355] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: W, [2026-10-15T06:16:26.410092 #921] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1104gitlab # [ 41.985381] postgres[1309]: [1309] ERROR: relation "feature_gates" does not exist at character 5231105gitlab # [ 41.985772] postgres[1309]: [1309] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1106gitlab # [ 41.987667] postgres[1309]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1107gitlab # [ 41.989924] postgres[1309]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1108gitlab # [ 41.992576] postgres[1309]: attidentity AS identity,1109gitlab # [ 41.994438] postgres[1309]: attgenerated as attgenerated1110gitlab # [ 41.996412] postgres[1309]: FROM pg_attribute a1111gitlab # [ 41.998411] postgres[1309]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1112gitlab # [ 42.000360] postgres[1309]: LEFT JOIN pg_type t ON a.atttypid = t.oid1113gitlab # [ 42.002246] postgres[1309]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1114gitlab # [ 42.004184] postgres[1309]: WHERE a.attrelid = '"feature_gates"'::regclass1115gitlab # [ 42.006139] postgres[1309]: AND a.attnum > 0 AND NOT a.attisdropped1116gitlab # [ 42.008086] postgres[1309]: ORDER BY a.attnum1117gitlab # [ 42.009961] postgres[1309]:1118gitlab # [ 45.282394] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1343]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 45.282785] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1343]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 48.196874] gitlab-workhorse[824]: time="2026-10-15T06:16:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 58.208306] gitlab-workhorse[824]: time="2026-10-15T06:16:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 60.361384] postgres[1409]: [1409] ERROR: relation "table_without_models" does not exist1123gitlab # [ 60.361905] postgres[1409]: [1409] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1124gitlab # [ 68.218643] gitlab-workhorse[824]: time="2026-10-15T06:16:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 72.363547] systemd[1]: Finished gitlab-db-config.service.1126gitlab # [ 72.370503] systemd[1]: Started gitlab-sidekiq.service.1127gitlab # [ 72.373318] systemd[1]: Starting gitlab.service...1128gitlab # [ 72.733256] bundle[1585]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1129gitlab # [ 72.733604] bundle[1585]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1130gitlab # [ 72.734696] bundle[1585]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1131gitlab # [ 75.400385] sidekiq-cluster[1584]: {"severity":"INFO","time":"2026-10-15T06:17:01.726Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 75.518630] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.841Z","pid":1585,"message":"* Enabling systemd notification integration"}1133gitlab # [ 75.518819] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.860Z","pid":1585,"message":"Puma starting in cluster mode..."}1134gitlab # [ 75.519457] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.860Z","pid":1585,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1135gitlab # [ 75.519978] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.860Z","pid":1585,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 75.520235] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.860Z","pid":1585,"message":"* Min threads: 0"}1137gitlab # [ 75.520702] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.860Z","pid":1585,"message":"* Max threads: 4"}1138gitlab # [ 75.521210] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.861Z","pid":1585,"message":"* Environment: production"}1139gitlab # [ 75.521720] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.861Z","pid":1585,"message":"* Master PID: 1585"}1140gitlab # [ 75.522404] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.861Z","pid":1585,"message":"* Workers: 2"}1141gitlab # [ 75.522926] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.861Z","pid":1585,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 75.523603] bundle[1585]: {"timestamp":"2026-10-15T06:17:01.861Z","pid":1585,"message":"* Preloading application"}1143gitlab # [ 78.228822] gitlab-workhorse[824]: time="2026-10-15T06:17:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 88.229931] gitlab-workhorse[824]: time="2026-10-15T06:17:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 98.067826] bundle[1585]: W, [2026-10-15T06:17:24.409457 #1585] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 98.231272] gitlab-workhorse[824]: time="2026-10-15T06:17:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1147gitlab # [ 100.079283] sidekiq-cluster[1615]: 2026-10-15T06:17:26.420Z pid=1615 tid=wkn INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1615, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431108096}1148gitlab # [ 100.245265] sidekiq-cluster[1615]: W, [2026-10-15T06:17:26.587598 #1615] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1149gitlab # [ 100.285058] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:26.627Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1150gitlab # [ 102.146920] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.488Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 102.147657] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.488Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 102.173390] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.515Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 102.177790] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.520Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 102.182291] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.524Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 102.186348] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.528Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 102.190836] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.533Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 102.195425] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.537Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 102.199544] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.542Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 102.203367] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.545Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 102.207258] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.549Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 102.214271] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.556Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 102.217944] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.560Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 102.223117] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.565Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 102.227111] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.569Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 102.230736] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.573Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 102.235370] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.577Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 102.240232] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.582Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 102.245956] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.588Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 102.250942] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.593Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 102.257685] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.600Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 102.264193] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.606Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 102.270359] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.612Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 102.275986] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.618Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 102.280951] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.623Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 102.286195] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.628Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 102.290984] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.633Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 102.296588] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.639Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 102.301987] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.644Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 102.307328] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.649Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 102.313807] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.656Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 102.318811] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.661Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 102.323991] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.666Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 102.329721] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.672Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 102.334948] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.677Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 102.341457] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.683Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 102.345347] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.687Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 102.350252] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.692Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 102.355770] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.698Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 102.361104] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.703Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 102.365652] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.708Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 102.369762] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.712Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 102.373815] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.716Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 102.377383] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.719Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 102.381258] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.723Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 102.384926] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.727Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 102.389096] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.731Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 102.393172] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.735Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 102.397407] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.739Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 102.401366] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.743Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 102.408387] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.750Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 102.414618] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.757Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 102.420674] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.763Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 102.427380] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.769Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 102.442161] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.784Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 102.448845] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.791Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 102.455096] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.797Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 102.461101] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.803Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 102.466410] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.808Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 102.472839] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.815Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 102.477818] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.820Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 102.482966] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.825Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 102.488915] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.831Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 102.493819] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.836Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 102.500098] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.842Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 102.505738] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.848Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 102.510064] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.852Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 102.514422] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.856Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 102.517976] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.860Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 102.521767] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.864Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 102.525481] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.868Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 102.529207] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.871Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 102.533363] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.875Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 102.537154] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.879Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 102.540881] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.883Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 102.545439] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.888Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 102.580395] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.922Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 102.587172] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.929Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 102.594778] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.937Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 102.603047] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.945Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 102.611287] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.953Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 102.618333] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.960Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 102.626747] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.969Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 102.635248] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.977Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 102.645445] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.987Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 102.652937] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:28.995Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 102.661419] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.003Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 102.668695] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.011Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 102.677759] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.020Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 102.685125] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.027Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 102.693328] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.035Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 102.700814] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.043Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 102.708851] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.051Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 102.716859] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.057Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 102.719108] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.061Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 102.722642] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.065Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 102.726965] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.069Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 102.730602] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.073Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 102.733851] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.076Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 102.736035] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.077Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 102.745467] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.088Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 102.749439] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.092Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 102.752326] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.094Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 102.756777] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.098Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 102.758909] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.101Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 102.761089] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.103Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 102.763491] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.105Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 102.765911] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.106Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 102.768257] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.109Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 102.773750] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.116Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 102.778680] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:29.121Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 104.872148] sidekiq-cluster[1615]: InitializerConnections Query: SET client_min_messages TO 'warning'1262gitlab # [ 104.875429] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1263gitlab # [ 104.878966] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1264gitlab # [ 104.882122] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1265gitlab # [ 104.885362] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1266gitlab # [ 104.888237] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1267gitlab # [ 104.891458] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1268gitlab # [ 104.894521] sidekiq-cluster[1615]: InitializerConnections Query: SET standard_conforming_strings = on1269gitlab # [ 104.896800] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1270gitlab # [ 104.899423] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1271gitlab # [ 104.901722] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1272gitlab # [ 104.904250] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1273gitlab # [ 104.906479] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1274gitlab # [ 104.908954] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1275gitlab # [ 104.910551] sidekiq-cluster[1615]: InitializerConnections Query: SET intervalstyle = iso_86011276gitlab # [ 104.911680] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1277gitlab # [ 104.913109] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1278gitlab # [ 104.914377] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1279gitlab # [ 104.915716] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1280gitlab # [ 104.916886] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1281gitlab # [ 104.918279] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1282gitlab # [ 104.919750] sidekiq-cluster[1615]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1283gitlab # [ 104.921529] sidekiq-cluster[1615]: FROM pg_type as t1284gitlab # [ 104.922202] sidekiq-cluster[1615]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1285gitlab # [ 104.923908] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1286gitlab # [ 104.925346] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1287gitlab # [ 104.926555] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1288gitlab # [ 104.927848] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1289gitlab # [ 104.929022] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1290gitlab # [ 104.930488] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1291gitlab # [ 104.931967] sidekiq-cluster[1615]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1292gitlab # [ 104.933421] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1293gitlab # [ 104.933981] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1294gitlab # [ 104.934788] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1295gitlab # [ 104.935623] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1296gitlab # [ 104.936445] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1297gitlab # [ 104.937122] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1298gitlab # [ 104.937430] sidekiq-cluster[1615]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1299gitlab # [ 104.938122] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1300gitlab # [ 104.938820] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1301gitlab # [ 104.939633] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1302gitlab # [ 104.940507] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1303gitlab # [ 104.941193] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1304gitlab # [ 104.941863] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1305gitlab # [ 108.232605] gitlab-workhorse[824]: time="2026-10-15T06:17:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1306gitlab # [ 118.242755] gitlab-workhorse[824]: time="2026-10-15T06:17:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1307gitlab # [ 127.098252] postgres[2053]: [2053] ERROR: relation "table_without_models" does not exist1308gitlab # [ 127.101053] postgres[2053]: [2053] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1309gitlab # [ 128.245459] gitlab-workhorse[824]: time="2026-10-15T06:17:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1310gitlab # [ 128.532369] postgres[2064]: [2064] ERROR: relation "table_without_models" does not exist1311gitlab # [ 128.535177] postgres[2064]: [2064] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1312gitlab # [ 129.732735] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:56.074Z","message":"Booted Rails 7.2.3.1 application in production environment"}1313gitlab # [ 129.734891] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:56.075Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1314gitlab # [ 129.736803] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:56.075Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1315gitlab # [ 129.738561] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:56.076Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1316gitlab # [ 129.740525] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:56.078Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1317gitlab # [ 131.019356] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:57.361Z","message":"Cleaning working queues"}1318gitlab # [ 131.022206] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:57.363Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6573bfffd6bd5a8a466c24a9","created_at":"2026-10-15T06:16:58.374Z","trace_propagation_headers":{"sentry-trace":"07d1ef8a5fac48c290b63993d38b7d08-63944aef62ef4925","baggage":"sentry-trace_id=07d1ef8a5fac48c290b63993d38b7d08,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"df2f0d360261b4926830c827b028fc0f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-15T06:16:58.383Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6573bfffd6bd5a8a466c24a9: start","job_status":"start","queue_duration_s":58.980655,"scheduling_latency_s":58.980698}1319gitlab # [ 131.192889] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:17:57.534Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6573bfffd6bd5a8a466c24a9","created_at":"2026-10-15T06:16:58.374Z","trace_propagation_headers":{"sentry-trace":"07d1ef8a5fac48c290b63993d38b7d08-63944aef62ef4925","baggage":"sentry-trace_id=07d1ef8a5fac48c290b63993d38b7d08,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"df2f0d360261b4926830c827b028fc0f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-15T06:16:58.383Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6573bfffd6bd5a8a466c24a9: done: 0.17105 sec","job_status":"done","queue_duration_s":58.980655,"scheduling_latency_s":58.980698,"redis_calls":31,"redis_duration_s":0.008631,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.004857,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002471,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.080460505,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.17105,"completed_at":"2026-10-15T06:17:57.534Z","load_balancing_strategy":"primary","db_duration_s":0.050011,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1320gitlab # [ 131.274286] bundle[1585]: {"timestamp":"2026-10-15T06:17:57.615Z","pid":1585,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1321gitlab # [ 131.274900] bundle[1585]: {"timestamp":"2026-10-15T06:17:57.616Z","pid":1585,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1322gitlab # [ 131.276106] bundle[1585]: {"timestamp":"2026-10-15T06:17:57.616Z","pid":1585,"message":"! #\u003cThread:0x00007fc153479f98 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1323gitlab # [ 131.276901] bundle[1585]: {"timestamp":"2026-10-15T06:17:57.616Z","pid":1585,"message":"! #\u003cThread:0x00007fc1536f2798 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1324gitlab # [ 131.277825] bundle[1585]: {"timestamp":"2026-10-15T06:17:57.616Z","pid":1585,"message":"Use Ctrl-C to stop"}1325gitlab # [ 131.278680] bundle[1585]: {"timestamp":"2026-10-15T06:17:57.616Z","pid":1585,"message":"Sending status to systemd every 1.0 sec"}1326gitlab # [ 131.571678] bundle[1585]: {"timestamp":"2026-10-15T06:17:57.914Z","pid":1585,"message":"- Worker 0 (PID: 2165) booted in 0.26s, phase: 0"}1327gitlab # [ 131.632490] bundle[1585]: {"timestamp":"2026-10-15T06:17:57.974Z","pid":1585,"message":"- Worker 1 (PID: 2169) booted in 0.3s, phase: 0"}1328gitlab # [ 131.638966] systemd[1]: Started gitlab.service.1329gitlab # [ 131.639181] systemd[1]: Reached target Common target for all GitLab services..1330gitlab # [ 131.641320] systemd[1]: Starting setup-gitlab.service...1331gitlab # [ 131.670185] setup-gitlab-start[2193]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1332gitlab # [ 133.922929] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:18:00 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 22261333gitlab # [ 133.930260] setup-gitlab-start[2193]: + TOKEN=nixbot-test-token-of-20-chars1334gitlab # [ 133.930421] setup-gitlab-start[2193]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1335gitlab # [ 133.952907] runuser[2211]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1336gitlab # [ 134.307827] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1337gitlab # [ 134.308344] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1338gitlab # [ 134.309478] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1339gitlab # [ 134.877234] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1340gitlab # [ 134.877617] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1341gitlab # [ 134.879269] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1342gitlab # [ 143.574503] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:09.916Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8c467eac759d525535af85e8","created_at":"2026-10-15T06:18:09.883Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27c60d3e270a06cf08096e05fd3203d7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:09.913Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8c467eac759d525535af85e8: start","job_status":"start","queue_duration_s":0.00236,"scheduling_latency_s":0.002395}1343gitlab # [ 143.720280] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.062Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8c467eac759d525535af85e8","created_at":"2026-10-15T06:18:09.883Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27c60d3e270a06cf08096e05fd3203d7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:09.913Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8c467eac759d525535af85e8: done: 0.146147 sec","job_status":"done","queue_duration_s":0.00236,"scheduling_latency_s":0.002395,"redis_calls":16,"redis_duration_s":0.016517,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.007722,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00197,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00086212,"duration_s":0.146147,"completed_at":"2026-10-15T06:18:10.062Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 143.782082] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.124Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3b0b83016ad5d4383edc59f6","created_at":"2026-10-15T06:18:09.952Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f931f3d16bd118e29dd7fee3a2379a73","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:09.971Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3b0b83016ad5d4383edc59f6: start","job_status":"start","queue_duration_s":0.152996,"scheduling_latency_s":0.153026}1345gitlab # [ 143.875072] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3b0b83016ad5d4383edc59f6","created_at":"2026-10-15T06:18:09.952Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f931f3d16bd118e29dd7fee3a2379a73","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:09.971Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3b0b83016ad5d4383edc59f6: done: 0.092492 sec","job_status":"done","queue_duration_s":0.152996,"scheduling_latency_s":0.153026,"redis_calls":13,"redis_duration_s":0.014450999999999999,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002524,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.008445,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003482,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.020595914,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.092492,"completed_at":"2026-10-15T06:18:10.216Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011881,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1346gitlab # [ 143.936615] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"49bf2e0094d51d819a45eed2","created_at":"2026-10-15T06:18:10.005Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c741a669be22f0d4afea05b229d2b1f1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.042Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-49bf2e0094d51d819a45eed2: start","job_status":"start","queue_duration_s":0.182258,"scheduling_latency_s":0.182294}1347gitlab # [ 143.970616] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"49bf2e0094d51d819a45eed2","created_at":"2026-10-15T06:18:10.005Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c741a669be22f0d4afea05b229d2b1f1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.042Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-49bf2e0094d51d819a45eed2: done: 0.087988 sec","job_status":"done","queue_duration_s":0.182258,"scheduling_latency_s":0.182294,"redis_calls":12,"redis_duration_s":0.019225,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005097,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002050819,"exclusive_lock_hold_duration_s":0.035115637,"duration_s":0.087988,"completed_at":"2026-10-15T06:18:10.312Z","load_balancing_strategy":"primary","db_duration_s":0.028248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 143.991994] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b71a91e2dc021f5ae42b57b0","created_at":"2026-10-15T06:18:10.057Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3967456ea1084be11d969c574732fd8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.122Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b71a91e2dc021f5ae42b57b0: start","job_status":"start","queue_duration_s":0.192878,"scheduling_latency_s":0.192912}1349gitlab # [ 144.026810] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.369Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1350gitlab # [ 144.042167] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b71a91e2dc021f5ae42b57b0","created_at":"2026-10-15T06:18:10.057Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3967456ea1084be11d969c574732fd8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.122Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b71a91e2dc021f5ae42b57b0: done: 0.068669 sec","job_status":"done","queue_duration_s":0.192878,"scheduling_latency_s":0.192912,"redis_calls":10,"redis_duration_s":0.035382,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.028776,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004576,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00203,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001561092,"duration_s":0.068669,"completed_at":"2026-10-15T06:18:10.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 144.080266] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1fef24358f5600d4cb091c2b","created_at":"2026-10-15T06:18:10.143Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff660310ba4362923abcb0b78cae6fb6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.160Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1fef24358f5600d4cb091c2b: start","job_status":"start","queue_duration_s":0.227078,"scheduling_latency_s":0.227094}1352gitlab # [ 144.168494] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1fef24358f5600d4cb091c2b","created_at":"2026-10-15T06:18:10.143Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff660310ba4362923abcb0b78cae6fb6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.160Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1fef24358f5600d4cb091c2b: done: 0.123066 sec","job_status":"done","queue_duration_s":0.227078,"scheduling_latency_s":0.227094,"redis_calls":14,"redis_duration_s":0.025564,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010892,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007647,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000662933,"exclusive_lock_hold_duration_s":0.063203284,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.123066,"completed_at":"2026-10-15T06:18:10.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035826,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 144.169691] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.512Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"b5d9b87c6fb6e175bb56eb9d","created_at":"2026-10-15T06:18:10.179Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1913df58acf5f8ddb401afeccc21800d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.193Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-b5d9b87c6fb6e175bb56eb9d: start","job_status":"start","queue_duration_s":0.318203,"scheduling_latency_s":0.318218}1354gitlab # [ 144.276918] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"b5d9b87c6fb6e175bb56eb9d","created_at":"2026-10-15T06:18:10.179Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1913df58acf5f8ddb401afeccc21800d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.193Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-b5d9b87c6fb6e175bb56eb9d: done: 0.106554 sec","job_status":"done","queue_duration_s":0.318203,"scheduling_latency_s":0.318218,"redis_calls":12,"redis_duration_s":0.074312,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.063894,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002005562,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.106554,"completed_at":"2026-10-15T06:18:10.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 144.318583] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8b71d6b35f17791ae1281391","created_at":"2026-10-15T06:18:10.211Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51862466a74a784f74aedb6bb75d3805","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.223Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8b71d6b35f17791ae1281391: start","job_status":"start","queue_duration_s":0.436558,"scheduling_latency_s":0.43661}1356gitlab # [ 144.427645] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8b71d6b35f17791ae1281391","created_at":"2026-10-15T06:18:10.211Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51862466a74a784f74aedb6bb75d3805","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.223Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8b71d6b35f17791ae1281391: done: 0.108882 sec","job_status":"done","queue_duration_s":0.436558,"scheduling_latency_s":0.43661,"redis_calls":10,"redis_duration_s":0.04342,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002798,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.039404,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.026717083,"duration_s":0.108882,"completed_at":"2026-10-15T06:18:10.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 144.494264] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"21da6f215506b27ed80c0dfc","created_at":"2026-10-15T06:18:10.248Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed4510614e1f165e26780275a926a719","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-15T06:18:10.264Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-21da6f215506b27ed80c0dfc: start","job_status":"start","queue_duration_s":0.524647,"scheduling_latency_s":0.524687}1358gitlab # [ 144.507061] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.813Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1359gitlab # [ 144.510547] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"21da6f215506b27ed80c0dfc","created_at":"2026-10-15T06:18:10.248Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed4510614e1f165e26780275a926a719","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-15T06:18:10.264Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-21da6f215506b27ed80c0dfc: done: 0.042881 sec","job_status":"done","queue_duration_s":0.524647,"scheduling_latency_s":0.524687,"redis_calls":10,"redis_duration_s":0.003778,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001479,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000616559,"duration_s":0.042881,"completed_at":"2026-10-15T06:18:10.832Z","load_balancing_strategy":"primary","db_duration_s":0.000724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 144.548471] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"87ffd21a17760c5de16b5d02","created_at":"2026-10-15T06:18:10.272Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a721881dfaa1c6bfff90fdacecfe5b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-15T06:18:10.281Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-87ffd21a17760c5de16b5d02: start","job_status":"start","queue_duration_s":0.553499,"scheduling_latency_s":0.553515}1361gitlab # [ 144.560716] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"87ffd21a17760c5de16b5d02","created_at":"2026-10-15T06:18:10.272Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a721881dfaa1c6bfff90fdacecfe5b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-15T06:18:10.281Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-87ffd21a17760c5de16b5d02: done: 0.038957 sec","job_status":"done","queue_duration_s":0.553499,"scheduling_latency_s":0.553515,"redis_calls":10,"redis_duration_s":0.001385,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235226,"duration_s":0.038957,"completed_at":"2026-10-15T06:18:10.874Z","load_balancing_strategy":"primary","db_duration_s":0.019413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 144.581945] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a99cfa52b19590c8a5eb6abc","created_at":"2026-10-15T06:18:10.294Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fee73df61498105c90046c3edc4c7bc6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.310Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a99cfa52b19590c8a5eb6abc: start","job_status":"start","queue_duration_s":0.568942,"scheduling_latency_s":0.568958}1363gitlab # [ 144.582650] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a99cfa52b19590c8a5eb6abc","created_at":"2026-10-15T06:18:10.294Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fee73df61498105c90046c3edc4c7bc6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.310Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a99cfa52b19590c8a5eb6abc: done: 0.019432 sec","job_status":"done","queue_duration_s":0.568942,"scheduling_latency_s":0.568958,"redis_calls":12,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000521,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218184,"duration_s":0.019432,"completed_at":"2026-10-15T06:18:10.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006221,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 144.623831] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.899Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"1e59dd371035f15803b04f16","created_at":"2026-10-15T06:18:10.333Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e806379fbae4cd4b8d91c9b68772fd7a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.344Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-1e59dd371035f15803b04f16: start","job_status":"start","queue_duration_s":0.554798,"scheduling_latency_s":0.554811}1365gitlab # [ 144.624660] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.915Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"1e59dd371035f15803b04f16","created_at":"2026-10-15T06:18:10.333Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e806379fbae4cd4b8d91c9b68772fd7a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.344Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-1e59dd371035f15803b04f16: done: 0.016238 sec","job_status":"done","queue_duration_s":0.554798,"scheduling_latency_s":0.554811,"redis_calls":10,"redis_duration_s":0.001753,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000392,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000335,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000433575,"duration_s":0.016238,"completed_at":"2026-10-15T06:18:10.915Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 144.658630] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:10.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0bb66ccc9df9b26170d09a80","created_at":"2026-10-15T06:18:10.353Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49e24fc16ec27838f53feb636e157943","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.359Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0bb66ccc9df9b26170d09a80: start","job_status":"start","queue_duration_s":0.557677,"scheduling_latency_s":0.55769}1367gitlab # [ 144.733604] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0bb66ccc9df9b26170d09a80","created_at":"2026-10-15T06:18:10.353Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49e24fc16ec27838f53feb636e157943","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.359Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0bb66ccc9df9b26170d09a80: done: 0.158242 sec","job_status":"done","queue_duration_s":0.557677,"scheduling_latency_s":0.55769,"redis_calls":12,"redis_duration_s":0.129773,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.127157,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000881676,"exclusive_lock_hold_duration_s":0.005666083,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.158242,"completed_at":"2026-10-15T06:18:11.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 144.773912] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d9fdbd1284c1e36dc3fae8f1","created_at":"2026-10-15T06:18:10.370Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e578f7210e3b3547d3dea4d1b064ae5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-15T06:18:10.383Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d9fdbd1284c1e36dc3fae8f1: start","job_status":"start","queue_duration_s":0.732896,"scheduling_latency_s":0.732922}1369gitlab # [ 144.807172] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.149Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1370gitlab # [ 144.819742] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d9fdbd1284c1e36dc3fae8f1","created_at":"2026-10-15T06:18:10.370Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e578f7210e3b3547d3dea4d1b064ae5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-15T06:18:10.383Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d9fdbd1284c1e36dc3fae8f1: done: 0.045596 sec","job_status":"done","queue_duration_s":0.732896,"scheduling_latency_s":0.732922,"redis_calls":10,"redis_duration_s":0.003597,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000687,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000692,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000500343,"duration_s":0.045596,"completed_at":"2026-10-15T06:18:11.161Z","load_balancing_strategy":"primary","db_duration_s":0.000842,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 144.821804] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ef89deef9e649dea8eac67d8","created_at":"2026-10-15T06:18:10.398Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a08907bed0003525dc9580cd257a4e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.409Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ef89deef9e649dea8eac67d8: start","job_status":"start","queue_duration_s":0.754553,"scheduling_latency_s":0.754579}1372gitlab # [ 144.834964] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.177Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1373gitlab # [ 144.840611] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.182Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ef89deef9e649dea8eac67d8","created_at":"2026-10-15T06:18:10.398Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a08907bed0003525dc9580cd257a4e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.409Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ef89deef9e649dea8eac67d8: done: 0.018732 sec","job_status":"done","queue_duration_s":0.754553,"scheduling_latency_s":0.754579,"redis_calls":10,"redis_duration_s":0.002675,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000592,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300038,"duration_s":0.018732,"completed_at":"2026-10-15T06:18:11.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 144.881301] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"69b3307f64792c0f5dd3afbc","created_at":"2026-10-15T06:18:10.425Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb71485227eb895d7c88136cf91b731c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.434Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-69b3307f64792c0f5dd3afbc: start","job_status":"start","queue_duration_s":0.749529,"scheduling_latency_s":0.749543}1375gitlab # [ 144.884630] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.197Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"69b3307f64792c0f5dd3afbc","created_at":"2026-10-15T06:18:10.425Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb71485227eb895d7c88136cf91b731c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.434Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-69b3307f64792c0f5dd3afbc: done: 0.013828 sec","job_status":"done","queue_duration_s":0.749529,"scheduling_latency_s":0.749543,"redis_calls":12,"redis_duration_s":0.002814,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000579,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000454,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000265397,"duration_s":0.013828,"completed_at":"2026-10-15T06:18:11.197Z","load_balancing_strategy":"primary","db_duration_s":0.000447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 144.942749] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.198Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1b81f6bc1e8d9dd550cd7311","created_at":"2026-10-15T06:18:10.450Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d2ca776793786dc45ed03fe39d160cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.457Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1b81f6bc1e8d9dd550cd7311: start","job_status":"start","queue_duration_s":0.741225,"scheduling_latency_s":0.741238}1377gitlab # [ 144.943524] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.253Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1b81f6bc1e8d9dd550cd7311","created_at":"2026-10-15T06:18:10.450Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d2ca776793786dc45ed03fe39d160cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.457Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1b81f6bc1e8d9dd550cd7311: done: 0.054274 sec","job_status":"done","queue_duration_s":0.741225,"scheduling_latency_s":0.741238,"redis_calls":12,"redis_duration_s":0.002865,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000464,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000502019,"exclusive_lock_hold_duration_s":0.034549922,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.054274,"completed_at":"2026-10-15T06:18:11.253Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 144.995058] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4479e95a52ea3873d507bc5f","created_at":"2026-10-15T06:18:10.479Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0dd8be6e7ae2461db5cb61cefb5d2493","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.489Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4479e95a52ea3873d507bc5f: start","job_status":"start","queue_duration_s":0.765419,"scheduling_latency_s":0.765451}1379gitlab # [ 144.995876] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.263Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1380gitlab # [ 144.996702] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4479e95a52ea3873d507bc5f","created_at":"2026-10-15T06:18:10.479Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0dd8be6e7ae2461db5cb61cefb5d2493","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.489Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4479e95a52ea3873d507bc5f: done: 0.013418 sec","job_status":"done","queue_duration_s":0.765419,"scheduling_latency_s":0.765451,"redis_calls":10,"redis_duration_s":0.001746,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000363,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000271543,"duration_s":0.013418,"completed_at":"2026-10-15T06:18:11.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 145.054117] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3a0f88c79fe8e57716f81ce8","created_at":"2026-10-15T06:18:10.501Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.509Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3a0f88c79fe8e57716f81ce8: start","job_status":"start","queue_duration_s":0.759783,"scheduling_latency_s":0.759796}1382gitlab # [ 145.054826] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.292Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3a0f88c79fe8e57716f81ce8","created_at":"2026-10-15T06:18:10.501Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.509Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3a0f88c79fe8e57716f81ce8: done: 0.022977 sec","job_status":"done","queue_duration_s":0.759783,"scheduling_latency_s":0.759796,"redis_calls":19,"redis_duration_s":0.003176,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000735,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000235,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001693,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230197,"duration_s":0.022977,"completed_at":"2026-10-15T06:18:11.292Z","load_balancing_strategy":"primary","db_duration_s":0.001711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 145.112739] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"af43f67c324d2367b21a4858","created_at":"2026-10-15T06:18:10.579Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f7d1feff38fe4a0460a0b75dfe908d9","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.597Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-af43f67c324d2367b21a4858: start","job_status":"start","queue_duration_s":0.695494,"scheduling_latency_s":0.695509}1384gitlab # [ 145.185625] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"af43f67c324d2367b21a4858","created_at":"2026-10-15T06:18:10.579Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f7d1feff38fe4a0460a0b75dfe908d9","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.597Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-af43f67c324d2367b21a4858: done: 0.234867 sec","job_status":"done","queue_duration_s":0.695494,"scheduling_latency_s":0.695509,"redis_calls":565,"redis_duration_s":0.06730699999999999,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.066035,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.190767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000249473,"duration_s":0.234867,"completed_at":"2026-10-15T06:18:11.527Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000422,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 145.186602] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"49962aec9b1027f252b5c122","created_at":"2026-10-15T06:18:10.607Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b797e8e116864cebca3f7cb51ee8811","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.678Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-49962aec9b1027f252b5c122: start","job_status":"start","queue_duration_s":0.850433,"scheduling_latency_s":0.850448}1386gitlab # [ 145.335618] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.677Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"49962aec9b1027f252b5c122","created_at":"2026-10-15T06:18:10.607Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b797e8e116864cebca3f7cb51ee8811","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.678Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-49962aec9b1027f252b5c122: done: 0.148371 sec","job_status":"done","queue_duration_s":0.850433,"scheduling_latency_s":0.850448,"redis_calls":14,"redis_duration_s":0.0028729999999999997,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000725,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000404521,"exclusive_lock_hold_duration_s":0.129055229,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.148371,"completed_at":"2026-10-15T06:18:11.677Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 145.337364] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c4e69803f7f707c8b6af6f23","created_at":"2026-10-15T06:18:10.702Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ba83622be225ecdb7df2f809edfd576","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.721Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c4e69803f7f707c8b6af6f23: start","job_status":"start","queue_duration_s":0.95784,"scheduling_latency_s":0.957855}1388gitlab # [ 145.375837] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c4e69803f7f707c8b6af6f23","created_at":"2026-10-15T06:18:10.702Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ba83622be225ecdb7df2f809edfd576","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.721Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c4e69803f7f707c8b6af6f23: done: 0.039343 sec","job_status":"done","queue_duration_s":0.95784,"scheduling_latency_s":0.957855,"redis_calls":10,"redis_duration_s":0.00142,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000835,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238858,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.039343,"completed_at":"2026-10-15T06:18:11.718Z","load_balancing_strategy":"primary","db_duration_s":0.023752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 145.426686] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.719Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0ad6bd011da0d9d3dd9813f8","created_at":"2026-10-15T06:18:10.756Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14923450cffd4d2bbd928178644a2173","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.775Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0ad6bd011da0d9d3dd9813f8: start","job_status":"start","queue_duration_s":0.943646,"scheduling_latency_s":0.943659}1390gitlab # [ 145.433848] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.726Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1391gitlab # [ 145.436980] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.731Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0ad6bd011da0d9d3dd9813f8","created_at":"2026-10-15T06:18:10.756Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14923450cffd4d2bbd928178644a2173","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.775Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0ad6bd011da0d9d3dd9813f8: done: 0.012139 sec","job_status":"done","queue_duration_s":0.943646,"scheduling_latency_s":0.943659,"redis_calls":10,"redis_duration_s":0.0012460000000000001,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207289,"duration_s":0.012139,"completed_at":"2026-10-15T06:18:11.731Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 145.484714] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"58aa1995387b3bedc6fc59cb","created_at":"2026-10-15T06:18:10.788Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.834Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-58aa1995387b3bedc6fc59cb: start","job_status":"start","queue_duration_s":0.897982,"scheduling_latency_s":0.897995}1393gitlab # [ 145.487929] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"58aa1995387b3bedc6fc59cb","created_at":"2026-10-15T06:18:10.788Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.834Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-58aa1995387b3bedc6fc59cb: done: 0.064032 sec","job_status":"done","queue_duration_s":0.897982,"scheduling_latency_s":0.897995,"redis_calls":71,"redis_duration_s":0.009698,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001228,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000603,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007453,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207847,"duration_s":0.064032,"completed_at":"2026-10-15T06:18:11.796Z","load_balancing_strategy":"primary","db_duration_s":0.000998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 145.528058] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4f18d764916a8d34c9551a76","created_at":"2026-10-15T06:18:10.847Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d19487bd30de72dca3a1c7567cbfd507","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.857Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4f18d764916a8d34c9551a76: start","job_status":"start","queue_duration_s":0.940117,"scheduling_latency_s":0.940131}1395gitlab # [ 145.574499] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4f18d764916a8d34c9551a76","created_at":"2026-10-15T06:18:10.847Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d19487bd30de72dca3a1c7567cbfd507","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.857Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4f18d764916a8d34c9551a76: done: 0.013278 sec","job_status":"done","queue_duration_s":0.940117,"scheduling_latency_s":0.940131,"redis_calls":10,"redis_duration_s":0.001191,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196953,"duration_s":0.013278,"completed_at":"2026-10-15T06:18:11.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000402,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 145.580120] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"487ee67edb57c75917fea647","created_at":"2026-10-15T06:18:10.863Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5899c5b71b0b9511af23b71b210ae6df","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.876Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-487ee67edb57c75917fea647: start","job_status":"start","queue_duration_s":0.934217,"scheduling_latency_s":0.93423}1397gitlab # [ 145.627158] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"487ee67edb57c75917fea647","created_at":"2026-10-15T06:18:10.863Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-55ae3e64e3ed4ba7","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5899c5b71b0b9511af23b71b210ae6df","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:10.876Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-487ee67edb57c75917fea647: done: 0.015086 sec","job_status":"done","queue_duration_s":0.934217,"scheduling_latency_s":0.93423,"redis_calls":12,"redis_duration_s":0.001552,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000549,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000296685,"exclusive_lock_hold_duration_s":0.003371936,"duration_s":0.015086,"completed_at":"2026-10-15T06:18:11.826Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 145.669040] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.827Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c521a1d3805bf726c235cc8b","created_at":"2026-10-15T06:18:11.279Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-46ea68410cc84f23","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.287Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c521a1d3805bf726c235cc8b: start","job_status":"start","queue_duration_s":0.540167,"scheduling_latency_s":0.540179}1399gitlab # [ 145.669816] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.840Z","message":"No existing merge request to be cleaned up."}1400gitlab # [ 145.670507] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.849Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c521a1d3805bf726c235cc8b","created_at":"2026-10-15T06:18:11.279Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-46ea68410cc84f23","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.287Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c521a1d3805bf726c235cc8b: done: 0.022231 sec","job_status":"done","queue_duration_s":0.540167,"scheduling_latency_s":0.540179,"redis_calls":13,"redis_duration_s":0.001848,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216508,"duration_s":0.022231,"completed_at":"2026-10-15T06:18:11.849Z","load_balancing_strategy":"primary","db_duration_s":0.006394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 145.680789] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.850Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1783b16f03c3dde4504d97c7","created_at":"2026-10-15T06:18:11.279Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-46ea68410cc84f23","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.287Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1783b16f03c3dde4504d97c7: start","job_status":"start","queue_duration_s":0.563327,"scheduling_latency_s":0.563341}1402gitlab # [ 145.691975] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.858Z","message":"No existing merge request to be cleaned up."}1403gitlab # [ 145.730796] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.864Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1783b16f03c3dde4504d97c7","created_at":"2026-10-15T06:18:11.279Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-46ea68410cc84f23","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.287Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1783b16f03c3dde4504d97c7: done: 0.014271 sec","job_status":"done","queue_duration_s":0.563327,"scheduling_latency_s":0.563341,"redis_calls":10,"redis_duration_s":0.001506,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014271,"completed_at":"2026-10-15T06:18:11.864Z","load_balancing_strategy":"primary","db_duration_s":0.003844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 145.732027] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.865Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b20ee3273dea12b33767f2c4","created_at":"2026-10-15T06:18:11.279Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-46ea68410cc84f23","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.287Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b20ee3273dea12b33767f2c4: start","job_status":"start","queue_duration_s":0.57857,"scheduling_latency_s":0.578585}1405gitlab # [ 145.738781] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.873Z","message":"No existing merge request to be cleaned up."}1406gitlab # [ 145.740570] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.879Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b20ee3273dea12b33767f2c4","created_at":"2026-10-15T06:18:11.279Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-46ea68410cc84f23","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.287Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b20ee3273dea12b33767f2c4: done: 0.013872 sec","job_status":"done","queue_duration_s":0.57857,"scheduling_latency_s":0.578585,"redis_calls":10,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000607,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000823,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013872,"completed_at":"2026-10-15T06:18:11.879Z","load_balancing_strategy":"primary","db_duration_s":0.003969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 145.801668] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.880Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"74272fda6a3c3daf1156839c","created_at":"2026-10-15T06:18:11.279Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-46ea68410cc84f23","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.287Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-74272fda6a3c3daf1156839c: start","job_status":"start","queue_duration_s":0.593307,"scheduling_latency_s":0.593321}1408gitlab # [ 145.802215] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.887Z","message":"No existing merge request to be cleaned up."}1409gitlab # [ 145.802752] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.891Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"74272fda6a3c3daf1156839c","created_at":"2026-10-15T06:18:11.279Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-46ea68410cc84f23","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"95c185a8d091091853ba8b6b9a8bf755","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.287Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-74272fda6a3c3daf1156839c: done: 0.011271 sec","job_status":"done","queue_duration_s":0.593307,"scheduling_latency_s":0.593321,"redis_calls":10,"redis_duration_s":0.001317,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011271,"completed_at":"2026-10-15T06:18:11.891Z","load_balancing_strategy":"primary","db_duration_s":0.001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 145.823237] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd90722b21724abf784258c","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd90722b21724abf784258c: start","job_status":"start","queue_duration_s":0.103065,"scheduling_latency_s":0.103078}1411gitlab # [ 145.864649] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd90722b21724abf784258c","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd90722b21724abf784258c: done: 0.016717 sec","job_status":"done","queue_duration_s":0.103065,"scheduling_latency_s":0.103078,"redis_calls":16,"redis_duration_s":0.002875,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001315,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001185,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206451,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016717,"completed_at":"2026-10-15T06:18:11.909Z","load_balancing_strategy":"primary","db_duration_s":0.000304,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 145.870620] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6240eafe93a4b6b9a4c918ea","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6240eafe93a4b6b9a4c918ea: start","job_status":"start","queue_duration_s":0.120589,"scheduling_latency_s":0.120602}1413gitlab # [ 145.881849] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6240eafe93a4b6b9a4c918ea","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6240eafe93a4b6b9a4c918ea: done: 0.013123 sec","job_status":"done","queue_duration_s":0.120589,"scheduling_latency_s":0.120602,"redis_calls":13,"redis_duration_s":0.00475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013123,"completed_at":"2026-10-15T06:18:11.923Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 145.929832] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20b461e4ae91eecd5f267ddf","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20b461e4ae91eecd5f267ddf: start","job_status":"start","queue_duration_s":0.134564,"scheduling_latency_s":0.134578}1415gitlab # [ 145.930811] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20b461e4ae91eecd5f267ddf","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20b461e4ae91eecd5f267ddf: done: 0.00974 sec","job_status":"done","queue_duration_s":0.134564,"scheduling_latency_s":0.134578,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00974,"completed_at":"2026-10-15T06:18:11.933Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 145.981100] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a056e38c766fe3ac698fa2f6","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a056e38c766fe3ac698fa2f6: start","job_status":"start","queue_duration_s":0.145328,"scheduling_latency_s":0.145341}1417gitlab # [ 145.981902] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a056e38c766fe3ac698fa2f6","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a056e38c766fe3ac698fa2f6: done: 0.009652 sec","job_status":"done","queue_duration_s":0.145328,"scheduling_latency_s":0.145341,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009652,"completed_at":"2026-10-15T06:18:11.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 146.009240] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48875283665d9eaeecff3bf3","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48875283665d9eaeecff3bf3: start","job_status":"start","queue_duration_s":0.155948,"scheduling_latency_s":0.155961}1419gitlab # [ 146.020786] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48875283665d9eaeecff3bf3","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48875283665d9eaeecff3bf3: done: 0.009411 sec","job_status":"done","queue_duration_s":0.155948,"scheduling_latency_s":0.155961,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009411,"completed_at":"2026-10-15T06:18:11.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 146.061313] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8ee3856f2ba989065b7458a","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8ee3856f2ba989065b7458a: start","job_status":"start","queue_duration_s":0.166329,"scheduling_latency_s":0.166343}1421gitlab # [ 146.104847] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8ee3856f2ba989065b7458a","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8ee3856f2ba989065b7458a: done: 0.009655 sec","job_status":"done","queue_duration_s":0.166329,"scheduling_latency_s":0.166343,"redis_calls":13,"redis_duration_s":0.0016749999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009655,"completed_at":"2026-10-15T06:18:11.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 146.105939] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad862843dc31cd6a5436aee7","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad862843dc31cd6a5436aee7: start","job_status":"start","queue_duration_s":0.17695,"scheduling_latency_s":0.176963}1423gitlab # [ 146.148794] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad862843dc31cd6a5436aee7","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad862843dc31cd6a5436aee7: done: 0.009676 sec","job_status":"done","queue_duration_s":0.17695,"scheduling_latency_s":0.176963,"redis_calls":13,"redis_duration_s":0.0016290000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009676,"completed_at":"2026-10-15T06:18:11.976Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 146.149938] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e43680928fa8555c2dcc312","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e43680928fa8555c2dcc312: start","job_status":"start","queue_duration_s":0.187695,"scheduling_latency_s":0.187708}1425gitlab # [ 146.192719] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e43680928fa8555c2dcc312","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e43680928fa8555c2dcc312: done: 0.012199 sec","job_status":"done","queue_duration_s":0.187695,"scheduling_latency_s":0.187708,"redis_calls":13,"redis_duration_s":0.00178,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012199,"completed_at":"2026-10-15T06:18:11.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 146.193760] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:11.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41bd1f2cf6d633bc197c3339","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41bd1f2cf6d633bc197c3339: start","job_status":"start","queue_duration_s":0.200974,"scheduling_latency_s":0.200994}1427gitlab # [ 146.235912] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41bd1f2cf6d633bc197c3339","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41bd1f2cf6d633bc197c3339: done: 0.010751 sec","job_status":"done","queue_duration_s":0.200974,"scheduling_latency_s":0.200994,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010751,"completed_at":"2026-10-15T06:18:12.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 146.274899] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62337d65d23be3572b81e0d7","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62337d65d23be3572b81e0d7: start","job_status":"start","queue_duration_s":0.212494,"scheduling_latency_s":0.212507}1429gitlab # [ 146.275707] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62337d65d23be3572b81e0d7","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62337d65d23be3572b81e0d7: done: 0.009889 sec","job_status":"done","queue_duration_s":0.212494,"scheduling_latency_s":0.212507,"redis_calls":13,"redis_duration_s":0.001615,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009889,"completed_at":"2026-10-15T06:18:12.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 146.286026] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"621504a37cb64cbd792615fd","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-621504a37cb64cbd792615fd: start","job_status":"start","queue_duration_s":0.223443,"scheduling_latency_s":0.223456}1431gitlab # [ 146.297559] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"621504a37cb64cbd792615fd","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-621504a37cb64cbd792615fd: done: 0.010012 sec","job_status":"done","queue_duration_s":0.223443,"scheduling_latency_s":0.223456,"redis_calls":13,"redis_duration_s":0.001584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010012,"completed_at":"2026-10-15T06:18:12.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 146.333654] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"872b5688713726172d8edf20","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-872b5688713726172d8edf20: start","job_status":"start","queue_duration_s":0.234294,"scheduling_latency_s":0.234307}1433gitlab # [ 146.344960] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"872b5688713726172d8edf20","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-872b5688713726172d8edf20: done: 0.009852 sec","job_status":"done","queue_duration_s":0.234294,"scheduling_latency_s":0.234307,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009852,"completed_at":"2026-10-15T06:18:12.033Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 146.391978] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be89a524bb4a42d8f18843cf","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be89a524bb4a42d8f18843cf: start","job_status":"start","queue_duration_s":0.24501,"scheduling_latency_s":0.245023}1435gitlab # [ 146.392645] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be89a524bb4a42d8f18843cf","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be89a524bb4a42d8f18843cf: done: 0.009635 sec","job_status":"done","queue_duration_s":0.24501,"scheduling_latency_s":0.245023,"redis_calls":13,"redis_duration_s":0.0015899999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009635,"completed_at":"2026-10-15T06:18:12.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 146.433151] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c26c3b725b2bc6ef6d3f6519","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c26c3b725b2bc6ef6d3f6519: start","job_status":"start","queue_duration_s":0.255622,"scheduling_latency_s":0.255635}1437gitlab # [ 146.475199] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c26c3b725b2bc6ef6d3f6519","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c26c3b725b2bc6ef6d3f6519: done: 0.009896 sec","job_status":"done","queue_duration_s":0.255622,"scheduling_latency_s":0.255635,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009896,"completed_at":"2026-10-15T06:18:12.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 146.476199] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6035919e190d817fe9c7b476","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6035919e190d817fe9c7b476: start","job_status":"start","queue_duration_s":0.266516,"scheduling_latency_s":0.266529}1439gitlab # [ 146.483613] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6035919e190d817fe9c7b476","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6035919e190d817fe9c7b476: done: 0.009949 sec","job_status":"done","queue_duration_s":0.266516,"scheduling_latency_s":0.266529,"redis_calls":13,"redis_duration_s":0.001702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009949,"completed_at":"2026-10-15T06:18:12.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 146.545713] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19a78ec837b94e7f3ec6cbf9","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19a78ec837b94e7f3ec6cbf9: start","job_status":"start","queue_duration_s":0.277487,"scheduling_latency_s":0.2775}1441gitlab # [ 146.546643] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19a78ec837b94e7f3ec6cbf9","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19a78ec837b94e7f3ec6cbf9: done: 0.009814 sec","job_status":"done","queue_duration_s":0.277487,"scheduling_latency_s":0.2775,"redis_calls":13,"redis_duration_s":0.001583,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009814,"completed_at":"2026-10-15T06:18:12.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 146.565865] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3db94113820fac6e83543a4","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3db94113820fac6e83543a4: start","job_status":"start","queue_duration_s":0.288346,"scheduling_latency_s":0.288359}1443gitlab # [ 146.577221] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3db94113820fac6e83543a4","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3db94113820fac6e83543a4: done: 0.058564 sec","job_status":"done","queue_duration_s":0.288346,"scheduling_latency_s":0.288359,"redis_calls":13,"redis_duration_s":0.001898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001254,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.058564,"completed_at":"2026-10-15T06:18:12.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 146.640326] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6049272ac2acd73da7b0abf","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6049272ac2acd73da7b0abf: start","job_status":"start","queue_duration_s":0.347901,"scheduling_latency_s":0.34792}1445gitlab # [ 146.641026] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6049272ac2acd73da7b0abf","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6049272ac2acd73da7b0abf: done: 0.009598 sec","job_status":"done","queue_duration_s":0.347901,"scheduling_latency_s":0.34792,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009598,"completed_at":"2026-10-15T06:18:12.147Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 146.658964] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b1c5eedf3b9c24f7461caa5","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b1c5eedf3b9c24f7461caa5: start","job_status":"start","queue_duration_s":0.358427,"scheduling_latency_s":0.35844}1447gitlab # [ 146.699854] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b1c5eedf3b9c24f7461caa5","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b1c5eedf3b9c24f7461caa5: done: 0.009329 sec","job_status":"done","queue_duration_s":0.358427,"scheduling_latency_s":0.35844,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009329,"completed_at":"2026-10-15T06:18:12.157Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 146.704888] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ae28608e101436bb5dab63d","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ae28608e101436bb5dab63d: start","job_status":"start","queue_duration_s":0.368628,"scheduling_latency_s":0.368641}1449gitlab # [ 146.716190] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ae28608e101436bb5dab63d","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ae28608e101436bb5dab63d: done: 0.009961 sec","job_status":"done","queue_duration_s":0.368628,"scheduling_latency_s":0.368641,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009961,"completed_at":"2026-10-15T06:18:12.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 146.752650] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d37d3f0f3a8b74c7203bcbda","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d37d3f0f3a8b74c7203bcbda: start","job_status":"start","queue_duration_s":0.379419,"scheduling_latency_s":0.379432}1451gitlab # [ 146.763816] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d37d3f0f3a8b74c7203bcbda","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d37d3f0f3a8b74c7203bcbda: done: 0.009999 sec","job_status":"done","queue_duration_s":0.379419,"scheduling_latency_s":0.379432,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009999,"completed_at":"2026-10-15T06:18:12.179Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 146.805041] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e500fb3aec04bb64ead83f1d","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e500fb3aec04bb64ead83f1d: start","job_status":"start","queue_duration_s":0.390315,"scheduling_latency_s":0.390327}1453gitlab # [ 146.809803] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e500fb3aec04bb64ead83f1d","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e500fb3aec04bb64ead83f1d: done: 0.009597 sec","job_status":"done","queue_duration_s":0.390315,"scheduling_latency_s":0.390327,"redis_calls":13,"redis_duration_s":0.001587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009597,"completed_at":"2026-10-15T06:18:12.189Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 146.857079] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07238f4c94e69ba4130ce3eb","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07238f4c94e69ba4130ce3eb: start","job_status":"start","queue_duration_s":0.400735,"scheduling_latency_s":0.400748}1455gitlab # [ 146.857907] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07238f4c94e69ba4130ce3eb","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07238f4c94e69ba4130ce3eb: done: 0.009553 sec","job_status":"done","queue_duration_s":0.400735,"scheduling_latency_s":0.400748,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009553,"completed_at":"2026-10-15T06:18:12.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 146.891828] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9644e923ac22c0b2034b3b8","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9644e923ac22c0b2034b3b8: start","job_status":"start","queue_duration_s":0.411117,"scheduling_latency_s":0.411129}1457gitlab # [ 146.903159] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9644e923ac22c0b2034b3b8","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9644e923ac22c0b2034b3b8: done: 0.009519 sec","job_status":"done","queue_duration_s":0.411117,"scheduling_latency_s":0.411129,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009519,"completed_at":"2026-10-15T06:18:12.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 146.965344] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d94cc35e5121773bf5d1d5c","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d94cc35e5121773bf5d1d5c: start","job_status":"start","queue_duration_s":0.421448,"scheduling_latency_s":0.421462}1459gitlab # [ 146.966095] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d94cc35e5121773bf5d1d5c","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d94cc35e5121773bf5d1d5c: done: 0.009568 sec","job_status":"done","queue_duration_s":0.421448,"scheduling_latency_s":0.421462,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009568,"completed_at":"2026-10-15T06:18:12.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 147.008115] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d4359204776f7d22b970a1f","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d4359204776f7d22b970a1f: start","job_status":"start","queue_duration_s":0.432231,"scheduling_latency_s":0.432244}1461gitlab # [ 147.008805] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d4359204776f7d22b970a1f","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d4359204776f7d22b970a1f: done: 0.009633 sec","job_status":"done","queue_duration_s":0.432231,"scheduling_latency_s":0.432244,"redis_calls":13,"redis_duration_s":0.001602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009633,"completed_at":"2026-10-15T06:18:12.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 147.050995] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dffcbdfd350cf658871e5521","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dffcbdfd350cf658871e5521: start","job_status":"start","queue_duration_s":0.442743,"scheduling_latency_s":0.442757}1463gitlab # [ 147.051833] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dffcbdfd350cf658871e5521","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dffcbdfd350cf658871e5521: done: 0.009481 sec","job_status":"done","queue_duration_s":0.442743,"scheduling_latency_s":0.442757,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009481,"completed_at":"2026-10-15T06:18:12.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 147.091960] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9e8f934014c6fd64857517b","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9e8f934014c6fd64857517b: start","job_status":"start","queue_duration_s":0.453108,"scheduling_latency_s":0.45312}1465gitlab # [ 147.092794] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9e8f934014c6fd64857517b","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9e8f934014c6fd64857517b: done: 0.009491 sec","job_status":"done","queue_duration_s":0.453108,"scheduling_latency_s":0.45312,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009491,"completed_at":"2026-10-15T06:18:12.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 147.152196] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0068d13b387089d92b233887","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0068d13b387089d92b233887: start","job_status":"start","queue_duration_s":0.463864,"scheduling_latency_s":0.463878}1467gitlab # [ 147.152898] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0068d13b387089d92b233887","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0068d13b387089d92b233887: done: 0.009695 sec","job_status":"done","queue_duration_s":0.463864,"scheduling_latency_s":0.463878,"redis_calls":13,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009695,"completed_at":"2026-10-15T06:18:12.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 147.170189] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fb854d7185c1bc207f5d812","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fb854d7185c1bc207f5d812: start","job_status":"start","queue_duration_s":0.474389,"scheduling_latency_s":0.474401}1469gitlab # [ 147.214364] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fb854d7185c1bc207f5d812","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fb854d7185c1bc207f5d812: done: 0.009426 sec","job_status":"done","queue_duration_s":0.474389,"scheduling_latency_s":0.474401,"redis_calls":13,"redis_duration_s":0.001894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001361,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009426,"completed_at":"2026-10-15T06:18:12.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 147.216627] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1302dc95b406ffe895242f3","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1302dc95b406ffe895242f3: start","job_status":"start","queue_duration_s":0.484641,"scheduling_latency_s":0.484654}1471gitlab # [ 147.255812] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1302dc95b406ffe895242f3","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1302dc95b406ffe895242f3: done: 0.009534 sec","job_status":"done","queue_duration_s":0.484641,"scheduling_latency_s":0.484654,"redis_calls":13,"redis_duration_s":0.001586,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009534,"completed_at":"2026-10-15T06:18:12.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 147.295027] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87d37b9dae0865cb5c1ed85d","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87d37b9dae0865cb5c1ed85d: start","job_status":"start","queue_duration_s":0.495055,"scheduling_latency_s":0.495069}1473gitlab # [ 147.295326] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87d37b9dae0865cb5c1ed85d","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87d37b9dae0865cb5c1ed85d: done: 0.00945 sec","job_status":"done","queue_duration_s":0.495055,"scheduling_latency_s":0.495069,"redis_calls":13,"redis_duration_s":0.0016159999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00945,"completed_at":"2026-10-15T06:18:12.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 147.308780] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ccacc4bdcaef146c42f8283","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ccacc4bdcaef146c42f8283: start","job_status":"start","queue_duration_s":0.505707,"scheduling_latency_s":0.50572}1475gitlab # [ 147.353167] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ccacc4bdcaef146c42f8283","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ccacc4bdcaef146c42f8283: done: 0.009708 sec","job_status":"done","queue_duration_s":0.505707,"scheduling_latency_s":0.50572,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009708,"completed_at":"2026-10-15T06:18:12.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 147.354985] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"122bc4dd637c602982a5eef8","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-122bc4dd637c602982a5eef8: start","job_status":"start","queue_duration_s":0.516313,"scheduling_latency_s":0.516326}1477gitlab # [ 147.401112] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"122bc4dd637c602982a5eef8","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-122bc4dd637c602982a5eef8: done: 0.009492 sec","job_status":"done","queue_duration_s":0.516313,"scheduling_latency_s":0.516326,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009492,"completed_at":"2026-10-15T06:18:12.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 147.401603] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3be432014200c50cf60860a7","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3be432014200c50cf60860a7: start","job_status":"start","queue_duration_s":0.526667,"scheduling_latency_s":0.52668}1479gitlab # [ 147.441115] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3be432014200c50cf60860a7","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3be432014200c50cf60860a7: done: 0.009566 sec","job_status":"done","queue_duration_s":0.526667,"scheduling_latency_s":0.52668,"redis_calls":13,"redis_duration_s":0.001657,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009566,"completed_at":"2026-10-15T06:18:12.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 147.447823] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8477788f8a89720eb8709219","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8477788f8a89720eb8709219: start","job_status":"start","queue_duration_s":0.53711,"scheduling_latency_s":0.537123}1481gitlab # [ 147.459255] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8477788f8a89720eb8709219","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8477788f8a89720eb8709219: done: 0.009393 sec","job_status":"done","queue_duration_s":0.53711,"scheduling_latency_s":0.537123,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009393,"completed_at":"2026-10-15T06:18:12.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 147.505142] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e155951023ff6dbf34e188cb","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e155951023ff6dbf34e188cb: start","job_status":"start","queue_duration_s":0.548951,"scheduling_latency_s":0.548983}1483gitlab # [ 147.506612] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e155951023ff6dbf34e188cb","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e155951023ff6dbf34e188cb: done: 0.012702 sec","job_status":"done","queue_duration_s":0.548951,"scheduling_latency_s":0.548983,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012702,"completed_at":"2026-10-15T06:18:12.351Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 147.555363] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1c3c3a2b802843853b14269","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1c3c3a2b802843853b14269: start","job_status":"start","queue_duration_s":0.562438,"scheduling_latency_s":0.562451}1485gitlab # [ 147.556130] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1c3c3a2b802843853b14269","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1c3c3a2b802843853b14269: done: 0.009708 sec","job_status":"done","queue_duration_s":0.562438,"scheduling_latency_s":0.562451,"redis_calls":13,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009708,"completed_at":"2026-10-15T06:18:12.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 147.596037] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"360abf7a50869790969637a3","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-360abf7a50869790969637a3: start","job_status":"start","queue_duration_s":0.572958,"scheduling_latency_s":0.572971}1487gitlab # [ 147.597966] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"360abf7a50869790969637a3","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-360abf7a50869790969637a3: done: 0.012561 sec","job_status":"done","queue_duration_s":0.572958,"scheduling_latency_s":0.572971,"redis_calls":13,"redis_duration_s":0.001779,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012561,"completed_at":"2026-10-15T06:18:12.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 147.633298] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a757c75413572f6e37339b20","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a757c75413572f6e37339b20: start","job_status":"start","queue_duration_s":0.586356,"scheduling_latency_s":0.58637}1489gitlab # [ 147.645178] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a757c75413572f6e37339b20","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a757c75413572f6e37339b20: done: 0.012429 sec","job_status":"done","queue_duration_s":0.586356,"scheduling_latency_s":0.58637,"redis_calls":13,"redis_duration_s":0.001728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012429,"completed_at":"2026-10-15T06:18:12.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 147.684759] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c86af215b25336b86128f0c","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c86af215b25336b86128f0c: start","job_status":"start","queue_duration_s":0.599986,"scheduling_latency_s":0.599999}1491gitlab # [ 147.724535] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c86af215b25336b86128f0c","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c86af215b25336b86128f0c: done: 0.009289 sec","job_status":"done","queue_duration_s":0.599986,"scheduling_latency_s":0.599999,"redis_calls":13,"redis_duration_s":0.0018150000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009289,"completed_at":"2026-10-15T06:18:12.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 147.725794] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34cafe9b2c137777b6568b52","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34cafe9b2c137777b6568b52: start","job_status":"start","queue_duration_s":0.610128,"scheduling_latency_s":0.61014}1493gitlab # [ 147.736002] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34cafe9b2c137777b6568b52","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34cafe9b2c137777b6568b52: done: 0.009143 sec","job_status":"done","queue_duration_s":0.610128,"scheduling_latency_s":0.61014,"redis_calls":13,"redis_duration_s":0.0015400000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009143,"completed_at":"2026-10-15T06:18:12.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 147.777980] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b6353617ae5dd199aa00913","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b6353617ae5dd199aa00913: start","job_status":"start","queue_duration_s":0.620141,"scheduling_latency_s":0.620155}1495gitlab # [ 147.781947] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b6353617ae5dd199aa00913","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b6353617ae5dd199aa00913: done: 0.009752 sec","job_status":"done","queue_duration_s":0.620141,"scheduling_latency_s":0.620155,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009752,"completed_at":"2026-10-15T06:18:12.419Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 147.817600] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5303c1ebb113fd6fd5a73ff","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5303c1ebb113fd6fd5a73ff: start","job_status":"start","queue_duration_s":0.630712,"scheduling_latency_s":0.630725}1497gitlab # [ 147.865765] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5303c1ebb113fd6fd5a73ff","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5303c1ebb113fd6fd5a73ff: done: 0.009411 sec","job_status":"done","queue_duration_s":0.630712,"scheduling_latency_s":0.630725,"redis_calls":13,"redis_duration_s":0.0015439999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009411,"completed_at":"2026-10-15T06:18:12.429Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 147.866907] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69f117a46acb67ac08ae09f8","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69f117a46acb67ac08ae09f8: start","job_status":"start","queue_duration_s":0.641469,"scheduling_latency_s":0.641482}1499gitlab # [ 147.873795] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69f117a46acb67ac08ae09f8","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69f117a46acb67ac08ae09f8: done: 0.009481 sec","job_status":"done","queue_duration_s":0.641469,"scheduling_latency_s":0.641482,"redis_calls":13,"redis_duration_s":0.0015049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009481,"completed_at":"2026-10-15T06:18:12.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 147.921069] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f32e357c6b583227bae3f69d","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f32e357c6b583227bae3f69d: start","job_status":"start","queue_duration_s":0.651782,"scheduling_latency_s":0.651795}1501gitlab # [ 147.921826] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f32e357c6b583227bae3f69d","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f32e357c6b583227bae3f69d: done: 0.009217 sec","job_status":"done","queue_duration_s":0.651782,"scheduling_latency_s":0.651795,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009217,"completed_at":"2026-10-15T06:18:12.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 147.965952] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff293349426f85ffd84301b7","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff293349426f85ffd84301b7: start","job_status":"start","queue_duration_s":0.661822,"scheduling_latency_s":0.661835}1503gitlab # [ 147.966784] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff293349426f85ffd84301b7","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff293349426f85ffd84301b7: done: 0.009029 sec","job_status":"done","queue_duration_s":0.661822,"scheduling_latency_s":0.661835,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009029,"completed_at":"2026-10-15T06:18:12.460Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 148.028158] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19ae013b47485abaac2895ec","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19ae013b47485abaac2895ec: start","job_status":"start","queue_duration_s":0.67167,"scheduling_latency_s":0.671682}1505gitlab # [ 148.028897] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19ae013b47485abaac2895ec","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19ae013b47485abaac2895ec: done: 0.009991 sec","job_status":"done","queue_duration_s":0.67167,"scheduling_latency_s":0.671682,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009991,"completed_at":"2026-10-15T06:18:12.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 148.047638] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c76460690fcd522c77448ce6","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c76460690fcd522c77448ce6: start","job_status":"start","queue_duration_s":0.682479,"scheduling_latency_s":0.682492}1507gitlab # [ 148.090847] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c76460690fcd522c77448ce6","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c76460690fcd522c77448ce6: done: 0.0094 sec","job_status":"done","queue_duration_s":0.682479,"scheduling_latency_s":0.682492,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0094,"completed_at":"2026-10-15T06:18:12.481Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 148.093253] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fee103179be2f4e848a5200f","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fee103179be2f4e848a5200f: start","job_status":"start","queue_duration_s":0.692745,"scheduling_latency_s":0.692757}1509gitlab # [ 148.138822] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:12.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fee103179be2f4e848a5200f","created_at":"2026-10-15T06:18:11.743Z","trace_propagation_headers":{"sentry-trace":"fbfc8fef97b4410484b75af3369114bf-a3ffc03f141748ec","baggage":"sentry-trace_id=fbfc8fef97b4410484b75af3369114bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7c2da841a74b2e45a22b6fa014c753b0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:18:11.789Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"mae3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fee103179be2f4e848a5200f: done: 0.00913 sec","job_status":"done","queue_duration_s":0.692745,"scheduling_latency_s":0.692757,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00913,"completed_at":"2026-10-15T06:18:12.491Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 148.329583] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1917996136 wd_nsec: 19179953171511gitlab # [ 159.504043] setup-gitlab-start[2212]: W, [2026-10-15T06:18:25.846272 #2212] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1512gitlab # [ 180.300290] postgres[2404]: [2404] ERROR: relation "table_without_models" does not exist1513gitlab # [ 180.302740] postgres[2404]: [2404] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1514gitlab # [ 183.098683] runuser[2211]: pam_unix(runuser:session): session closed for user gitlab1515gitlab # [ 183.099704] setup-gitlab-start[2193]: + systemctl restart gitlab-sidekiq.service1516gitlab # [ 183.126054] systemd[1]: Stopping gitlab-sidekiq.service...1517gitlab # [ 183.126586] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:49.468Z","message":"Shutting down"}1518gitlab # [ 183.127538] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:49.469Z","message":"Scheduler exiting..."}1519gitlab # [ 183.129578] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:49.472Z","message":"Terminating quiet threads for default capsule"}1520gitlab # [ 183.130852] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:49.473Z","message":"Scheduler exiting..."}1521gitlab # [ 183.632232] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:49.974Z","message":"Pausing to allow jobs to finish..."}1522gitlab # [ 186.636597] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:52.978Z","message":"Bye!"}1523gitlab # [ 186.660768] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-10-15T06:18:53.003Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1615,"worker_id":"sidekiq_0","memwd_rss_bytes":938508288,"retry":0}1524gitlab # [ 187.481351] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1525gitlab # [ 187.484072] systemd[1]: Stopped gitlab-sidekiq.service.1526gitlab # [ 187.485869] systemd[1]: gitlab-sidekiq.service: Consumed 55.379s CPU time over 1min 55.110s wall clock time, 956.6M memory peak, 4.4M read from disk.1527gitlab # [ 187.494358] systemd[1]: Started gitlab-sidekiq.service.1528gitlab # [ 187.498965] setup-gitlab-start[2193]: + mkdir -p /var/lib/secrets1529gitlab # [ 187.504344] setup-gitlab-start[2193]: + echo nixbot-test-token-of-20-chars1530gitlab # [ 187.506861] setup-gitlab-start[2193]: + chmod 644 /var/lib/secrets/gitlab-token1531gitlab # [ 187.509397] setup-gitlab-start[2193]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1532gitlab # [ 187.934932] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:18:54 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 3881533gitlab # [ 188.479955] gitaly[912]: time="2026-10-15T06:18:54.821Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:04.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:54.820" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 188.480484] gitaly[912]: time="2026-10-15T06:18:54.821Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:04.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:54.820" grpc.time_ms=0.429 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 188.664548] gitaly[912]: time="2026-10-15T06:18:55.007Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:05.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.006" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1536gitlab # [ 188.687410] gitaly[912]: time="2026-10-15T06:18:55.007Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:05.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.006" grpc.time_ms=0.495 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1537gitlab # [ 188.770838] gitaly[912]: time="2026-10-15T06:18:55.113Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH diskcache=e5d769f9-4620-4c84-927d-2e80d1619ea2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-15T06:19:05.059" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.059" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1538gitlab # [ 188.786444] gitaly[912]: time="2026-10-15T06:18:55.128Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:05.127" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.128" pid=912 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1539gitlab # [ 188.788918] gitaly[912]: time="2026-10-15T06:18:55.131Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:05.127" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.128" grpc.time_ms=3.048 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1540gitlab # [ 188.819342] gitaly[912]: time="2026-10-15T06:18:55.161Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-15T06:19:05.059" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.059" grpc.time_ms=53.569 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1541gitlab # [ 188.825563] gitaly[912]: time="2026-10-15T06:18:55.168Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-15T06:19:05.137" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.161" grpc.time_ms=6.657 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1542gitlab # [ 188.887230] gitaly[912]: time="2026-10-15T06:18:55.229Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:05.228" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.229" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1543gitlab # [ 188.887520] gitaly[912]: time="2026-10-15T06:18:55.229Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:05.228" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.229" grpc.time_ms=0.415 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1544gitlab # [ 188.966603] gitaly[912]: time="2026-10-15T06:18:55.309Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH diskcache=3b8a6e69-366f-4e24-b817-c2540ec8d295 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-15T06:19:05.259" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.260" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1545gitlab # [ 188.967170] gitaly[912]: time="2026-10-15T06:18:55.309Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1573 command.oublock=32 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-15T06:19:05.259" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.260" grpc.time_ms=49.024 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1546gitlab # [ 189.009629] gitaly[912]: time="2026-10-15T06:18:55.352Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:05.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.351" pid=912 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1547gitlab # [ 189.010255] gitaly[912]: time="2026-10-15T06:18:55.352Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:05.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.351" grpc.time_ms=0.843 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 189.026770] gitaly[912]: time="2026-10-15T06:18:55.368Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-15T06:19:05.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.357" grpc.time_ms=11.07 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1549gitlab # [ 189.062142] gitaly[912]: time="2026-10-15T06:18:55.404Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:05.063" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.404" grpc.time_ms=0.288 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1550gitlab # [ 189.081730] gitaly[912]: time="2026-10-15T06:18:55.424Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-15T06:19:05.083" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.423" grpc.time_ms=0.239 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1551gitlab # [ 189.559872] gitaly[912]: time="2026-10-15T06:18:55.902Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DCEWQ5GQD92N2P8HG8YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-15T06:19:05.082" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:18:55.893" grpc.time_ms=8.622 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1552gitlab # [ 189.823343] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:18:56 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 18631553gitlab # [ 189.827944] setup-gitlab-start[2458]: {"id":1,"message":null,"error":null}1554gitlab # [ 190.763725] sidekiq-cluster[2446]: {"severity":"INFO","time":"2026-10-15T06:18:57.087Z","message":"Starting cluster with 1 processes"}1555gitlab # [ 194.999636] gitaly[912]: time="2026-10-15T06:19:01.341Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DK66Z7TJPYPVGQ72WMWS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-15T06:19:11.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:01.330" grpc.time_ms=10.821 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1556gitlab # [ 195.085423] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:01 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 2331557gitlab # [ 195.092427] setup-gitlab-start[2193]: + mkdir -p /tmp/test-flake1558gitlab # [ 195.095345] setup-gitlab-start[2193]: + cd /tmp/test-flake1559gitlab # [ 195.096103] setup-gitlab-start[2193]: + git init -b master1560gitlab # [ 195.126151] setup-gitlab-start[2534]: Initialized empty Git repository in /tmp/test-flake/.git/1561gitlab # [ 195.128991] setup-gitlab-start[2193]: + git config user.name test1562gitlab # [ 195.134429] setup-gitlab-start[2193]: + git config user.email test@example.com1563gitlab # [ 195.138235] setup-gitlab-start[2193]: + cat1564gitlab # [ 195.143600] setup-gitlab-start[2193]: + git add flake.nix1565gitlab # [ 195.151366] setup-gitlab-start[2193]: + git commit -m 'initial commit'1566gitlab # [ 195.176509] setup-gitlab-start[2539]: [master (root-commit) 9105469] initial commit1567gitlab # [ 195.179195] setup-gitlab-start[2539]: 1 file changed, 10 insertions(+)1568gitlab # [ 195.181389] setup-gitlab-start[2539]: create mode 100644 flake.nix1569gitlab # [ 195.182059] setup-gitlab-start[2193]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1570gitlab # [ 195.187530] setup-gitlab-start[2193]: + git push -u origin master1571gitlab # [ 195.257703] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:01 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 391572gitlab # [ 195.360836] gitaly[912]: time="2026-10-15T06:19:01.703Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKK5AFTY2ZRSV99HWJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:01.691" grpc.time_ms=11.859 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1573gitlab # [ 195.390290] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:01 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 991574gitlab # [ 195.779235] gitaly[912]: time="2026-10-15T06:19:02.121Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-15T06:19:12.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:02.114" grpc.time_ms=6.243 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 195.814718] gitaly[912]: time="2026-10-15T06:19:02.157Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-15T06:19:32.050" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-15T06:19:02.150" grpc.time_ms=6.624 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1576gitlab # [ 195.834918] gitaly[912]: time="2026-10-15T06:19:02.177Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W duration_ms=289ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/allowed"1577gitlab # [ 195.856889] gitaly[912]: time="2026-10-15T06:19:02.199Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W duration_ms=21ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/pre_receive"1578gitlab # [ 195.859955] gitaly[912]: time="2026-10-15T06:19:02.200Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:01.887" grpc.time_ms=312.326 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1579gitlab # [ 195.901689] gitaly[912]: time="2026-10-15T06:19:02.244Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:02.243" grpc.time_ms=0.818 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1580gitlab # [ 195.935397] gitaly[912]: time="2026-10-15T06:19:02.277Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:02.277" grpc.time_ms=0.424 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1581gitlab # [ 195.965323] gitaly[912]: time="2026-10-15T06:19:02.307Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:02.307" grpc.time_ms=0.361 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1582gitlab # [ 196.084220] gitaly[912]: time="2026-10-15T06:19:02.425Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-15T06:19:12.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:02.419" grpc.time_ms=5.805 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 196.113344] gitaly[912]: time="2026-10-15T06:19:02.450Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-15T06:19:12.023" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:02.433" grpc.time_ms=16.268 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 196.138413] gitaly[912]: time="2026-10-15T06:19:02.460Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W duration_ms=123ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/post_receive"1585gitlab # [ 196.141492] gitaly[912]: time="2026-10-15T06:19:02.460Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:02.335" grpc.time_ms=124.689 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1586gitlab # [ 196.151758] gitaly[912]: time="2026-10-15T06:19:02.491Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W diskcache=a89f6eef-bc31-4e22-875d-595f869479d6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:01.807" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1587gitlab # [ 196.161579] gitlab-workhorse[824]: time="2026-10-15T06:19:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521588gitlab # [ 196.163431] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:02 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7491589gitlab # [ 196.165401] setup-gitlab-start[2543]: To http://gitlab/root/test-flake.git1590gitlab # [ 196.166322] setup-gitlab-start[2543]: * [new branch] master -> master1591gitlab # [ 196.167287] setup-gitlab-start[2543]: branch 'master' set up to track 'origin/master'.1592gitlab # [ 196.168376] gitaly[912]: time="2026-10-15T06:19:02.492Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=205 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13326 command.oublock=32 command.real_time_ms=671 command.spawn_token_fork_ms=0 command.system_time_ms=143 command.user_time_ms=62 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:01.807" grpc.time_ms=684.411 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1593gitlab # [ 196.180619] systemd[1]: Finished setup-gitlab.service.1594gitlab # [ 196.181470] systemd[1]: Starting nixbot CI service...1595gitlab: (finished: waiting for unit setup-gitlab.service, in 197.26 seconds)1596gitlab: waiting for unit nixbot.service1597gitlab # [ 197.380130] nixbot[2629]: {"ts": "2026-10-15T06:19:03.721Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1598gitlab # [ 197.412233] nixbot[2629]: {"ts": "2026-10-15T06:19:03.754Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1599gitlab # [ 197.440312] nixbot[2629]: {"ts": "2026-10-15T06:19:03.782Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1600gitlab # [ 197.446936] nixbot[2629]: {"ts": "2026-10-15T06:19:03.789Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1601gitlab # [ 197.452097] nixbot[2629]: {"ts": "2026-10-15T06:19:03.794Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1602gitlab # [ 197.459962] nixbot[2629]: {"ts": "2026-10-15T06:19:03.802Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1603gitlab # [ 197.465189] nixbot[2629]: {"ts": "2026-10-15T06:19:03.807Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1604gitlab # [ 197.470049] nixbot[2629]: {"ts": "2026-10-15T06:19:03.811Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1605gitlab # [ 197.476814] nixbot[2629]: {"ts": "2026-10-15T06:19:03.819Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1606gitlab # [ 197.483405] nixbot[2629]: {"ts": "2026-10-15T06:19:03.822Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1607gitlab # [ 197.491362] nixbot[2629]: {"ts": "2026-10-15T06:19:03.833Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1608gitlab # [ 197.505259] nixbot[2629]: {"ts": "2026-10-15T06:19:03.847Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1609gitlab # [ 197.510529] nixbot[2629]: {"ts": "2026-10-15T06:19:03.852Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1610gitlab # [ 197.515721] nixbot[2629]: {"ts": "2026-10-15T06:19:03.856Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1611gitlab # [ 197.519309] nixbot[2629]: {"ts": "2026-10-15T06:19:03.861Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1612gitlab # [ 197.522814] nixbot[2629]: {"ts": "2026-10-15T06:19:03.865Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1613gitlab # [ 197.526112] nixbot[2629]: {"ts": "2026-10-15T06:19:03.868Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1614gitlab # [ 197.530697] nixbot[2629]: {"ts": "2026-10-15T06:19:03.873Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1615gitlab # [ 197.537949] nixbot[2629]: {"ts": "2026-10-15T06:19:03.880Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1616gitlab # [ 197.542089] nixbot[2629]: {"ts": "2026-10-15T06:19:03.883Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1617gitlab # [ 197.546052] nixbot[2629]: {"ts": "2026-10-15T06:19:03.886Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1618gitlab # [ 197.550337] nixbot[2629]: {"ts": "2026-10-15T06:19:03.892Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1619gitlab # [ 197.553346] nixbot[2629]: {"ts": "2026-10-15T06:19:03.895Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1620gitlab # [ 197.558769] nixbot[2629]: {"ts": "2026-10-15T06:19:03.901Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1621gitlab # [ 197.562982] nixbot[2629]: {"ts": "2026-10-15T06:19:03.905Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1622gitlab # [ 197.567663] nixbot[2629]: {"ts": "2026-10-15T06:19:03.910Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1623gitlab # [ 197.571651] nixbot[2629]: {"ts": "2026-10-15T06:19:03.914Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1624gitlab # [ 197.575542] nixbot[2629]: {"ts": "2026-10-15T06:19:03.917Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1625gitlab # [ 197.579509] nixbot[2629]: {"ts": "2026-10-15T06:19:03.921Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1626gitlab # [ 197.598905] nixbot[2629]: {"ts": "2026-10-15T06:19:03.941Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1627gitlab # [ 197.607604] nixbot[2629]: {"ts": "2026-10-15T06:19:03.949Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1628gitlab # [ 197.613505] nixbot[2629]: {"ts": "2026-10-15T06:19:03.955Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1629gitlab # [ 197.615938] nixbot[2629]: {"ts": "2026-10-15T06:19:03.958Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1630gitlab # [ 197.622827] nixbot[2629]: {"ts": "2026-10-15T06:19:03.965Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1631gitlab # [ 197.626056] nixbot[2629]: {"ts": "2026-10-15T06:19:03.968Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1632gitlab # [ 197.634547] nixbot[2629]: {"ts": "2026-10-15T06:19:03.976Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1633gitlab # [ 197.639259] nixbot[2629]: {"ts": "2026-10-15T06:19:03.981Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1634gitlab # [ 197.645321] nixbot[2629]: {"ts": "2026-10-15T06:19:03.987Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1635gitlab # [ 197.988935] nixbot[2629]: {"ts": "2026-10-15T06:19:04.331Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2629]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"}1636gitlab # [ 197.989620] nixbot[2629]: {"ts": "2026-10-15T06:19:04.331Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"}1637gitlab # [ 198.028691] nixbot[2629]: {"ts": "2026-10-15T06:19:04.368Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:52862 - \"GET /health HTTP/1.1\" 200"}1638gitlab # [ 198.037133] systemd[1]: Started nixbot CI service.1639gitlab # [ 198.041096] systemd[1]: Reached target Multi-User System.1640gitlab # [ 198.043186] systemd[1]: Startup finished in 1.200s (kernel) + 3.556s (initrd) + 3min 13.285s (userspace) = 3min 18.042s.1641gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1642gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1643gitlab # [ 198.703939] nixbot[2629]: {"ts": "2026-10-15T06:19:05.045Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:52866 - \"GET /health HTTP/1.1\" 200"}1644gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1645subtest: project discovered and webhook registered1646gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1647gitlab # [ 198.761935] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:05 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7321648gitlab # [ 198.776680] nixbot[2629]: {"ts": "2026-10-15T06:19:05.119Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1649gitlab # [ 198.787631] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 451650gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1651gitlab # [ 198.818823] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 311652gitlab # [ 198.821655] nixbot[2629]: {"ts": "2026-10-15T06:19:05.164Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1653gitlab # [ 198.967174] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 1391654gitlab # [ 199.110155] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:05 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1351655gitlab # [ 199.191410] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 671656gitlab # [ 199.301913] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:05 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 1031657gitlab # [ 199.441277] gitaly[912]: time="2026-10-15T06:19:05.783Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DQHPJ9Q4EHWY8CJEE0YS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-15T06:19:35.067" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:05.767" grpc.time_ms=15.227 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 199.452068] gitaly[912]: time="2026-10-15T06:19:05.794Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DQHPJ9Q4EHWY8CJEE0YS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:19:35.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:05.794" grpc.time_ms=0.539 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 199.507839] gitaly[912]: time="2026-10-15T06:19:05.850Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DQHPJ9Q4EHWY8CJEE0YS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-15T06:19:15.031" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:05.842" grpc.time_ms=7.7 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1660gitlab # [ 199.531666] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2191661gitlab # [ 199.605671] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 681662gitlab # [ 199.616961] nixbot[2629]: {"ts": "2026-10-15T06:19:05.959Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1663gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1664gitlab # [ 199.777475] gitaly[912]: time="2026-10-15T06:19:06.119Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DQXZE8Z8BAC3P0C3J4C9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.108" grpc.time_ms=11.506 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1665gitlab # [ 199.806241] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1001666gitlab # [ 199.914598] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 751667gitlab # [ 199.915352] gitaly[912]: time="2026-10-15T06:19:06.257Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DR1AHE7DKQW7TC58NDR0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.245" pid=912 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1668gitlab # [ 199.916551] gitaly[912]: time="2026-10-15T06:19:06.258Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DR1AHE7DKQW7TC58NDR0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.245" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1669gitlab # [ 199.917462] gitlab-workhorse[824]: time="2026-10-15T06:19:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131670gitlab # [ 199.918526] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1031671gitlab # [ 199.919649] gitaly[912]: time="2026-10-15T06:19:06.258Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DR1AHE7DKQW7TC58NDR0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.245" grpc.time_ms=12.214 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1672gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds)1673(finished: subtest: project discovered and webhook registered, in 1.27 seconds)1674subtest: push delivers the webhook1675gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1676gitlab # [ 200.043345] gitaly[912]: time="2026-10-15T06:19:06.385Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DR6K5VVBFGF7GC0BRDSK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.374" pid=912 remote_ip="2001:db8:1::1" request_sha=808cfc3fc6f027c0ac53cc9827024fa1afbd58ed response_bytes=223 span.kind=server system=grpc1677gitlab # [ 200.043597] gitaly[912]: time="2026-10-15T06:19:06.386Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DR6K5VVBFGF7GC0BRDSK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.374" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1678gitlab # [ 200.044485] gitaly[912]: time="2026-10-15T06:19:06.386Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DR6K5VVBFGF7GC0BRDSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.374" grpc.time_ms=11.923 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1679gitlab # [ 200.045084] gitlab-workhorse[824]: time="2026-10-15T06:19:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231680gitlab # [ 200.045661] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 631681gitlab # [ 200.164492] gitaly[912]: time="2026-10-15T06:19:06.507Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRAW5053TJJQ9CW83W0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.494" grpc.time_ms=12.27 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1682gitlab # [ 200.190829] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 721683gitlab # [ 200.279070] gitaly[912]: time="2026-10-15T06:19:06.621Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRD7AP63Z70SJJ9AT38A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.608" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1684gitlab # [ 200.279980] gitaly[912]: time="2026-10-15T06:19:06.621Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRD7AP63Z70SJJ9AT38A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.608" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1685gitlab # [ 200.332475] gitaly[912]: time="2026-10-15T06:19:06.674Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRD7AP63Z70SJJ9AT38A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.608" grpc.time_ms=66.056 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1686gitlab # [ 200.333637] gitlab-workhorse[824]: time="2026-10-15T06:19:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671687gitlab # [ 200.335591] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1391688gitlab # [ 200.445578] gitaly[912]: time="2026-10-15T06:19:06.787Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRK5DXP03STSE0DKJTM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.778" grpc.time_ms=9.57 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1689gitlab # [ 200.446332] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 631690gitlab # [ 200.498719] gitaly[912]: time="2026-10-15T06:19:06.841Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRN7NZ8VKV74DVHJGDJR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.825" pid=912 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1691gitlab # [ 200.518691] gitaly[912]: time="2026-10-15T06:19:06.841Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRN7NZ8VKV74DVHJGDJR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.825" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1692gitlab # [ 200.534047] gitaly[912]: time="2026-10-15T06:19:06.860Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRN7NZ8VKV74DVHJGDJR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:06.825" grpc.time_ms=34.841 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1693gitlab # [ 200.547061] gitlab-workhorse[824]: time="2026-10-15T06:19:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091694gitlab # [ 200.548910] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 681695gitlab # [ 200.640293] gitaly[912]: time="2026-10-15T06:19:06.982Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:19:36.881" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:06.981" grpc.time_ms=0.598 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1696gitlab # [ 200.716355] gitaly[912]: time="2026-10-15T06:19:07.058Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-15T06:19:37.043" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:07.043" grpc.time_ms=14.859 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697gitlab # [ 200.758311] gitaly[912]: time="2026-10-15T06:19:07.100Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:17.019" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:07.090" grpc.time_ms=10.496 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698gitlab # [ 200.771764] gitaly[912]: time="2026-10-15T06:19:07.114Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:17.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:07.107" grpc.time_ms=6.563 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699gitlab # [ 200.888964] gitaly[912]: time="2026-10-15T06:19:07.231Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-15T06:19:17.119" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:07.230" grpc.time_ms=0.399 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1700gitlab # [ 200.934600] gitaly[912]: time="2026-10-15T06:19:07.277Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=618 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-15T06:19:17.154" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:07.265" grpc.time_ms=11.354 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701gitlab # [ 200.990909] gitaly[912]: time="2026-10-15T06:19:07.333Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:07.331" grpc.time_ms=1.303 pid=912 span.kind=server system=grpc1702gitlab # [ 201.038402] gitaly[912]: time="2026-10-15T06:19:07.380Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:07.380" grpc.time_ms=0.303 pid=912 span.kind=server system=grpc1703gitlab # [ 201.056395] gitaly[912]: time="2026-10-15T06:19:07.398Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA diskcache=a2eeb562-bee6-4b20-8a9c-41d3dce61379 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-15T06:19:17.169" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:07.280" pid=912 ref=refs/keep-around/91054694512521db0ee5a785e3e4f7a6e262ca52 remote_ip="2001:db8:1::1" revision=91054694512521db0ee5a785e3e4f7a6e262ca52 span.kind=server system=grpc username=root1704gitlab # [ 201.066672] gitaly[912]: time="2026-10-15T06:19:07.409Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5201 command.oublock=8 command.real_time_ms=107 command.spawn_token_fork_ms=0 command.system_time_ms=45 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-15T06:19:17.169" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:07.280" grpc.time_ms=118.665 pid=912 ref=refs/keep-around/91054694512521db0ee5a785e3e4f7a6e262ca52 remote_ip="2001:db8:1::1" revision=91054694512521db0ee5a785e3e4f7a6e262ca52 span.kind=server system=grpc username=root1705gitlab # [ 201.083361] gitaly[912]: time="2026-10-15T06:19:07.425Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:19:37.325" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:07.425" grpc.time_ms=0.29 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1706gitlab # [ 201.218330] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/91054694512521db0ee5a785e3e4f7a6e262ca52 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 6251707gitlab # [ 201.231104] nixbot[2629]: {"ts": "2026-10-15T06:19:07.572Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-910546945125-0"}1708gitlab # [ 201.391413] nixbot[2629]: {"ts": "2026-10-15T06:19:07.733Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-910546945125-0", "argv0": "bwrap"}1709gitlab # [ 201.490075] systemd[1]: Started Nix Daemon.1710gitlab # [ 201.550063] nix-daemon[2795]: accepted connection from pid 2790, user nixbot1711gitlab # [ 206.274586] nix-daemon[2795]: accepted connection from pid 2841, user nixbot1712gitlab # [ 206.283571] nix-daemon[2795]: accepted connection from pid 2790, user nixbot1713gitlab # [ 211.277985] nix-daemon[2795]: accepted connection from pid 2790, user nixbot1714gitlab # [ 211.378607] nix-daemon[2795]: accepted connection from pid 2887, user nixbot1715gitlab # [ 211.412799] gitaly[912]: time="2026-10-15T06:19:17.755Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3E3A84QQ4A0C9KBHS9086 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:19:47.652" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:17.752" grpc.time_ms=2.542 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1716gitlab # [ 211.441123] gitaly[912]: time="2026-10-15T06:19:17.783Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3E3A84QQ4A0C9KBHS9086 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:27.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:17.771" grpc.time_ms=12.298 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1717gitlab # [ 211.470092] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/91054694512521db0ee5a785e3e4f7a6e262ca52 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1071718gitlab # [ 211.508621] gitaly[912]: time="2026-10-15T06:19:17.851Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3E3DVR1XP1TMT2A1R5JAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:19:47.750" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:17.850" grpc.time_ms=0.443 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1719gitlab # [ 211.563499] gitaly[912]: time="2026-10-15T06:19:17.905Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3E3DVR1XP1TMT2A1R5JAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:27.125" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:17.895" grpc.time_ms=10.013 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720gitlab # [ 211.622978] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/91054694512521db0ee5a785e3e4f7a6e262ca52 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1451721gitlab # [ 215.150124] sidekiq-cluster[2506]: 2026-10-15T06:19:21.491Z pid=2506 tid=xuq INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2506, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430952448}1722gitlab # [ 215.316290] sidekiq-cluster[2506]: W, [2026-10-15T06:19:21.658626 #2506] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1723gitlab # [ 215.353480] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:21.695Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1724gitlab # [ 216.274083] nix-daemon[2795]: accepted connection from pid 2964, user nixbot1725gitlab # [ 216.364560] gitaly[912]: time="2026-10-15T06:19:22.706Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3E84NYHA5S18MA36EQ2V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:19:52.604" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:22.705" grpc.time_ms=0.883 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726gitlab # [ 216.409412] gitaly[912]: time="2026-10-15T06:19:22.751Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3E84NYHA5S18MA36EQ2V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:32.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:22.741" grpc.time_ms=10.204 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1727gitlab # [ 216.479781] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/91054694512521db0ee5a785e3e4f7a6e262ca52 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1761728gitlab # [ 216.669975] nixbot[2629]: {"ts": "2026-10-15T06:19:23.011Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "91054694512521db0ee5a785e3e4f7a6e262ca52", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}1729gitlab # [ 216.776750] gitaly[912]: time="2026-10-15T06:19:23.119Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3E8HD2VG0FDFCRFA6ZZEF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:23.106" grpc.time_ms=12.883 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1730gitlab # [ 216.777604] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 661731gitlab # [ 216.820150] gitaly[912]: time="2026-10-15T06:19:23.162Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3E8KKJT6CJPEMM4P3V43V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:23.156" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1732gitlab # [ 216.833273] gitaly[912]: time="2026-10-15T06:19:23.162Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3E8KKJT6CJPEMM4P3V43V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:23.156" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1733gitlab # [ 216.845307] gitaly[912]: time="2026-10-15T06:19:23.187Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3E8KKJT6CJPEMM4P3V43V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:23.156" grpc.time_ms=19.728 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1734gitlab # [ 216.845976] gitlab-workhorse[824]: time="2026-10-15T06:19:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671735gitlab # [ 216.846599] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 651736gitlab # [ 216.935966] gitaly[912]: time="2026-10-15T06:19:23.278Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3E8Q29NNTEXTXSJ7CKAME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:23.271" grpc.time_ms=7.162 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1737gitlab # [ 216.937075] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 451738gitlab # [ 216.991960] gitaly[912]: time="2026-10-15T06:19:23.334Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3E8RXAH20SK8NQJQBBBBZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:23.327" pid=912 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1739gitlab # [ 216.992224] gitaly[912]: time="2026-10-15T06:19:23.334Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3E8RXAH20SK8NQJQBBBBZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:23.327" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1740gitlab # [ 216.993094] gitaly[912]: time="2026-10-15T06:19:23.334Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3E8RXAH20SK8NQJQBBBBZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:23.327" grpc.time_ms=7.488 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1741gitlab # [ 217.019576] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:23.361Z","message":"GitLab reliable fetch activated!"}1742gitlab # [ 217.020150] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:23.361Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1743gitlab # [ 217.035904] gitlab-workhorse[824]: time="2026-10-15T06:19:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671744gitlab # [ 217.036718] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 841745gitlab # [ 236.626610] postgres[3176]: [3176] ERROR: relation "table_without_models" does not exist1746gitlab # [ 236.626989] postgres[3176]: [3176] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1747gitlab # [ 239.059810] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:45.401Z","message":"Booted Rails 7.2.3.1 application in production environment"}1748gitlab # [ 239.061793] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:45.404Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1749gitlab # [ 239.063227] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:45.404Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1750gitlab # [ 239.065321] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:45.404Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1751gitlab # [ 239.066649] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:45.406Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1752gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 39.50 seconds)1753gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1754gitlab # [ 239.574577] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 341755gitlab # [ 239.664358] gitaly[912]: time="2026-10-15T06:19:46.006Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EYW2X2A7REEQ324Y7F8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:45.994" grpc.time_ms=11.844 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1756gitlab # [ 239.665340] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:46 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 841757gitlab # Enumerating objects: 5, done.1758gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1759gitlab # Delta compression using up to 4 threads1760gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1761gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1762gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1763gitlab # [ 239.899860] gitaly[912]: time="2026-10-15T06:19:46.242Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=333 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-15T06:20:16.031" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-15T06:19:46.232" grpc.time_ms=9.425 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 239.931399] gitaly[912]: time="2026-10-15T06:19:46.255Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 duration_ms=77ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/allowed"1765gitlab # [ 239.940226] gitaly[912]: time="2026-10-15T06:19:46.275Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 duration_ms=18ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/pre_receive"1766gitlab # [ 239.945393] gitaly[912]: time="2026-10-15T06:19:46.275Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:46.177" grpc.time_ms=97.98 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1767gitlab # [ 239.965739] gitaly[912]: time="2026-10-15T06:19:46.308Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:46.307" grpc.time_ms=0.416 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1768gitlab # [ 239.999374] gitaly[912]: time="2026-10-15T06:19:46.341Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:46.341" grpc.time_ms=0.294 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1769gitlab # [ 240.028809] gitaly[912]: time="2026-10-15T06:19:46.371Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:46.370" grpc.time_ms=0.352 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1770gitlab # [ 240.086634] gitaly[912]: time="2026-10-15T06:19:46.429Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 duration_ms=29ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/post_receive"1771gitlab # [ 240.091973] gitaly[912]: time="2026-10-15T06:19:46.429Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:46.399" grpc.time_ms=30.156 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1772gitlab # [ 240.118153] gitaly[912]: time="2026-10-15T06:19:46.460Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 diskcache=07403327-a9e8-4356-8eb0-e1c54a56da92 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:46.116" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1773gitlab # [ 240.127535] gitaly[912]: time="2026-10-15T06:19:46.470Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=168 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13508 command.oublock=32 command.real_time_ms=335 command.spawn_token_fork_ms=0 command.system_time_ms=115 command.user_time_ms=53 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:46.116" grpc.time_ms=344.575 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1774gitlab # [ 240.140204] gitlab-workhorse[824]: time="2026-10-15T06:19:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521775gitlab # To http://gitlab/root/test-flake.git1776gitlab # [ 240.142275] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:46 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4191777gitlab # 9105469..b6a58e7 master -> master1778gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.66 seconds)1779gitlab: must succeed: git -C /tmp/test-flake rev-parse master1780gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1781gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1'1782gitlab # [ 240.213855] nixbot[2629]: {"ts": "2026-10-15T06:19:46.555Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:44496 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1\" 200"}1783gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1', in 0.06 seconds)1784gitlab # [ 240.318186] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:46.659Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"88033f499ac66054220a470e","created_at":"2026-10-15T06:18:55.180Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.214Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-88033f499ac66054220a470e: start","job_status":"start","queue_duration_s":51.444591,"scheduling_latency_s":51.444658}1785gitlab # [ 240.565365] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:46.907Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"88033f499ac66054220a470e","created_at":"2026-10-15T06:18:55.180Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.214Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-88033f499ac66054220a470e: done: 0.247855 sec","job_status":"done","queue_duration_s":51.444591,"scheduling_latency_s":51.444658,"redis_calls":25,"redis_duration_s":0.008225,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004481,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002175,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001569,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.109365017,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.247855,"completed_at":"2026-10-15T06:19:46.906Z","load_balancing_strategy":"primary","db_duration_s":0.066743,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1786gitlab # [ 240.567546] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:46.909Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"c4809b3a19689c0d12c91576","created_at":"2026-10-15T06:18:55.221Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.225Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-c4809b3a19689c0d12c91576: start","job_status":"start","queue_duration_s":51.683303,"scheduling_latency_s":51.683332}1787gitlab # [ 240.746926] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:47.089Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"c4809b3a19689c0d12c91576","created_at":"2026-10-15T06:18:55.221Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.225Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-c4809b3a19689c0d12c91576: done: 0.180139 sec","job_status":"done","queue_duration_s":51.683303,"scheduling_latency_s":51.683332,"redis_calls":14,"redis_duration_s":0.077538,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.074914,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001552,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.084439783,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.180139,"completed_at":"2026-10-15T06:19:47.089Z","load_balancing_strategy":"primary","db_duration_s":0.025495,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1788gitlab # [ 240.820826] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:47.162Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0162aa85e4d742fcde18ac89","created_at":"2026-10-15T06:18:55.790Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.795Z","job_size_bytes":5,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0162aa85e4d742fcde18ac89: start","job_status":"start","queue_duration_s":51.367189,"scheduling_latency_s":51.367232}1789gitlab # [ 240.961892] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:47.304Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0162aa85e4d742fcde18ac89","created_at":"2026-10-15T06:18:55.790Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.795Z","job_size_bytes":5,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0162aa85e4d742fcde18ac89: done: 0.141579 sec","job_status":"done","queue_duration_s":51.367189,"scheduling_latency_s":51.367232,"redis_calls":12,"redis_duration_s":0.0031119999999999997,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000904,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001736,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000336076,"duration_s":0.141579,"completed_at":"2026-10-15T06:19:47.304Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027175,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1790gitlab # [ 240.965256] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:47.305Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"dc81b73b080d7d0143d0fa92","created_at":"2026-10-15T06:18:55.816Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.819Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-dc81b73b080d7d0143d0fa92: start","job_status":"start","queue_duration_s":51.485995,"scheduling_latency_s":51.486009}1791gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1'1792gitlab # [ 241.162157] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:47.503Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"dc81b73b080d7d0143d0fa92","created_at":"2026-10-15T06:18:55.816Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.819Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-dc81b73b080d7d0143d0fa92: done: 0.198615 sec","job_status":"done","queue_duration_s":51.485995,"scheduling_latency_s":51.486009,"redis_calls":11,"redis_duration_s":0.002979,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00062,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.169,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.169,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000531911,"duration_s":0.198615,"completed_at":"2026-10-15T06:19:47.503Z","load_balancing_strategy":"primary","db_duration_s":0.076067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1793gitlab # [ 241.163817] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:47.506Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"7de92c345ce44e2caef7e6a8","created_at":"2026-10-15T06:18:55.821Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.824Z","job_size_bytes":89,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-7de92c345ce44e2caef7e6a8: start","job_status":"start","queue_duration_s":51.681612,"scheduling_latency_s":51.681639}1794gitlab # [ 241.246190] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:47.535Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"7de92c345ce44e2caef7e6a8","created_at":"2026-10-15T06:18:55.821Z","trace_propagation_headers":{"sentry-trace":"534898a744e14ef0ac801fd2af6f4b9d-45607aa0bbb74d93","baggage":"sentry-trace_id=534898a744e14ef0ac801fd2af6f4b9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DCEWQ5GQD92N2P8HG8YH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-15T06:18:55.824Z","job_size_bytes":89,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-7de92c345ce44e2caef7e6a8: done: 0.029633 sec","job_status":"done","queue_duration_s":51.681612,"scheduling_latency_s":51.681639,"redis_calls":11,"redis_duration_s":0.0025399999999999997,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000746,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000455,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000321549,"duration_s":0.029633,"completed_at":"2026-10-15T06:19:47.535Z","load_balancing_strategy":"primary","db_duration_s":0.005815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1795gitlab # [ 241.251785] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:47.536Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 91054694512521db0ee5a785e3e4f7a6e262ca52 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"3664fb7e28a33f2bb1e3e622","created_at":"2026-10-15T06:19:02.361Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-7562caa14c8c4c68","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:19:02.381Z","job_size_bytes":185,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-3664fb7e28a33f2bb1e3e622: start","job_status":"start","queue_duration_s":45.155223,"scheduling_latency_s":45.155236}1796gitlab # [ 241.267129] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:47.547Z","message":"changes: \"0000000000000000000000000000000000000000 91054694512521db0ee5a785e3e4f7a6e262ca52 refs/heads/master\\n\""}1797gitlab # [ 241.269515] gitaly[912]: time="2026-10-15T06:19:47.577Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:57.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:47.568" grpc.time_ms=8.881 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 241.317967] gitaly[912]: time="2026-10-15T06:19:47.592Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-15T06:19:57.020" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:47.581" grpc.time_ms=10.646 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 241.318603] gitaly[912]: time="2026-10-15T06:19:47.651Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-15T06:19:57.083" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:47.643" grpc.time_ms=7.692 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 241.343558] gitaly[912]: time="2026-10-15T06:19:47.686Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:47.685" grpc.time_ms=0.253 pid=912 span.kind=server system=grpc1801gitlab # [ 241.362090] gitaly[912]: time="2026-10-15T06:19:47.704Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:47.703" grpc.time_ms=0.331 pid=912 span.kind=server system=grpc1802gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1', in 0.15 seconds)1803gitlab # [ 241.369315] nixbot[2629]: {"ts": "2026-10-15T06:19:47.711Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:44506 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1\" 200"}1804gitlab # [ 241.381845] gitaly[912]: time="2026-10-15T06:19:47.724Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W diskcache=1789f210-d528-443a-91f6-db3a013318d1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-15T06:19:57.100" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:47.660" pid=912 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1805gitlab # [ 241.382207] gitaly[912]: time="2026-10-15T06:19:47.724Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=54 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4982 command.oublock=8 command.real_time_ms=56 command.spawn_token_fork_ms=0 command.system_time_ms=32 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-15T06:19:57.100" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:47.660" grpc.time_ms=63.975 pid=912 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1806gitlab # [ 241.393068] gitaly[912]: time="2026-10-15T06:19:47.735Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-15T06:19:57.175" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:47.735" grpc.time_ms=0.142 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 241.402465] gitaly[912]: time="2026-10-15T06:19:47.745Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=938 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-15T06:19:57.177" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:47.737" grpc.time_ms=7.071 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 241.458687] gitaly[912]: time="2026-10-15T06:19:47.801Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-15T06:20:17.095" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:47.796" grpc.time_ms=4.706 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab # [ 241.490966] gitaly[912]: time="2026-10-15T06:19:47.833Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-15T06:19:57.272" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:47.833" grpc.time_ms=0.228 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 241.507807] gitaly[912]: time="2026-10-15T06:19:47.850Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-15T06:19:57.285" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-15T06:19:47.845" grpc.time_ms=4.776 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 241.528942] gitaly[912]: time="2026-10-15T06:19:47.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:57.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:47.864" grpc.time_ms=7.236 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812gitlab # [ 241.544230] gitaly[912]: time="2026-10-15T06:19:47.886Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:57.018" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:47.879" grpc.time_ms=7.29 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 241.582325] gitaly[912]: time="2026-10-15T06:19:47.924Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=969 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-15T06:20:17.210" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:47.911" grpc.time_ms=13.639 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 241.995065] gitaly[912]: time="2026-10-15T06:19:48.337Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-15T06:19:58.005" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:48.335" grpc.time_ms=1.458 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 242.041963] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:48.383Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 91054694512521db0ee5a785e3e4f7a6e262ca52 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"3664fb7e28a33f2bb1e3e622","created_at":"2026-10-15T06:19:02.361Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-7562caa14c8c4c68","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:19:02.381Z","job_size_bytes":185,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-3664fb7e28a33f2bb1e3e622: done: 0.846457 sec","job_status":"done","queue_duration_s":45.155223,"scheduling_latency_s":45.155236,"gitaly_calls":13,"gitaly_duration_s":0.193911,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.045909,"redis_read_bytes":2103,"redis_write_bytes":21748,"redis_cache_calls":15,"redis_cache_duration_s":0.003866,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.007088,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001404,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003271,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.017076,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.013204,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.196,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.215,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.535393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000433016,"exclusive_lock_hold_duration_s":0.023663622999999998,"duration_s":0.846457,"completed_at":"2026-10-15T06:19:48.383Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086621,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1816gitlab # [ 242.088298] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:48.385Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"533acdfc30f5dc24ffe19796","created_at":"2026-10-15T06:19:07.431Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-2ecfa86831c54054","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:07.437Z","job_size_bytes":65,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-533acdfc30f5dc24ffe19796: start","job_status":"start","queue_duration_s":40.948615,"scheduling_latency_s":40.948649}1817gitlab # [ 242.122456] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:48.464Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"533acdfc30f5dc24ffe19796","created_at":"2026-10-15T06:19:07.431Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-2ecfa86831c54054","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:07.437Z","job_size_bytes":65,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-533acdfc30f5dc24ffe19796: done: 0.078867 sec","job_status":"done","queue_duration_s":40.948615,"scheduling_latency_s":40.948649,"redis_calls":16,"redis_duration_s":0.004510999999999999,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001999,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300318,"duration_s":0.078867,"completed_at":"2026-10-15T06:19:48.464Z","load_balancing_strategy":"primary","db_duration_s":0.02241,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1818gitlab # [ 242.163713] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:48.466Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"96377125ec805519c54d3f3a","created_at":"2026-10-15T06:19:07.437Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-2ecfa86831c54054","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:07.440Z","job_size_bytes":65,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-96377125ec805519c54d3f3a: start","job_status":"start","queue_duration_s":41.025054,"scheduling_latency_s":41.025068}1819gitlab # [ 242.213134] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:48.555Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"96377125ec805519c54d3f3a","created_at":"2026-10-15T06:19:07.437Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-2ecfa86831c54054","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:07.440Z","job_size_bytes":65,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-96377125ec805519c54d3f3a: done: 0.089217 sec","job_status":"done","queue_duration_s":41.025054,"scheduling_latency_s":41.025068,"redis_calls":21,"redis_duration_s":0.004484,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002007,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001217,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000282997,"duration_s":0.089217,"completed_at":"2026-10-15T06:19:48.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1820gitlab # [ 242.214980] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:48.556Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"df9a0d6634619d43b1e5ef69","created_at":"2026-10-15T06:19:07.543Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-2ecfa86831c54054","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:07.548Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-df9a0d6634619d43b1e5ef69: start","job_status":"start","queue_duration_s":41.008355,"scheduling_latency_s":41.00837}1821gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1'1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1', in 0.04 seconds)1823gitlab # [ 242.410122] nixbot[2629]: {"ts": "2026-10-15T06:19:48.751Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:44516 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1\" 200"}1824gitlab # [ 242.506349] gitaly[912]: time="2026-10-15T06:19:48.848Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:48.847" grpc.time_ms=0.751 pid=912 span.kind=server system=grpc1825gitlab # [ 242.566595] gitaly[912]: time="2026-10-15T06:19:48.909Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:48.908" grpc.time_ms=0.645 pid=912 span.kind=server system=grpc1826gitlab # [ 242.614233] gitaly[912]: time="2026-10-15T06:19:48.956Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:48.955" grpc.time_ms=0.605 pid=912 span.kind=server system=grpc1827gitlab # [ 242.641396] gitaly[912]: time="2026-10-15T06:19:48.983Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA diskcache=0d24691f-906b-4399-8857-427c940253df grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:18.110" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:48.811" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1828gitlab # [ 242.641915] gitaly[912]: time="2026-10-15T06:19:48.984Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=138 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7631 command.oublock=0 command.real_time_ms=164 command.spawn_token_fork_ms=0 command.system_time_ms=78 command.user_time_ms=60 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:18.110" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:48.811" grpc.time_ms=172.487 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab # [ 242.775854] gitaly[912]: time="2026-10-15T06:19:49.118Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-15T06:20:19.016" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.116" grpc.time_ms=1.205 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1830gitlab # [ 242.803445] gitaly[912]: time="2026-10-15T06:19:49.145Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DRSP7GENE7TQSE7DRQFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:19.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.144" grpc.time_ms=0.663 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1831gitlab # [ 242.811606] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.153Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"df9a0d6634619d43b1e5ef69","created_at":"2026-10-15T06:19:07.543Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-2ecfa86831c54054","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:07.548Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2506,"job_status":"rescheduled","message":"PipelineProcessWorker JID-df9a0d6634619d43b1e5ef69: rescheduled"}1832gitlab # [ 242.818161] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.160Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"df9a0d6634619d43b1e5ef69","created_at":"2026-10-15T06:19:07.543Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-2ecfa86831c54054","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:07.548Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-df9a0d6634619d43b1e5ef69: done: 0.603918 sec","job_status":"done","queue_duration_s":41.008355,"scheduling_latency_s":41.00837,"gitaly_calls":3,"gitaly_duration_s":0.206708,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.02982,"redis_read_bytes":460,"redis_write_bytes":29293,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001616,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001388,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010794,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004561,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15580,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005607,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000903,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00073,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002605,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.104,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.025,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.03,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.250469,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.5060578920000001,"duration_s":0.603918,"completed_at":"2026-10-15T06:19:49.160Z","load_balancing_strategy":"primary","db_duration_s":0.120603,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1833gitlab # [ 242.869937] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.161Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","91054694512521db0ee5a785e3e4f7a6e262ca52 b6a58e71d3a2c27b910b4e1e57499f553f6202f1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2d597618653b95c453d9d145","created_at":"2026-10-15T06:19:46.418Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-ddcc9602ef30418b","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:19:46.420Z","job_size_bytes":185,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2d597618653b95c453d9d145: start","job_status":"start","queue_duration_s":2.741678,"scheduling_latency_s":2.741692}1834gitlab # [ 242.870843] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.169Z","message":"changes: \"91054694512521db0ee5a785e3e4f7a6e262ca52 b6a58e71d3a2c27b910b4e1e57499f553f6202f1 refs/heads/master\\n\""}1835gitlab # [ 242.921675] gitaly[912]: time="2026-10-15T06:19:49.264Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:59.072" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:49.253" grpc.time_ms=10.957 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 242.950638] gitaly[912]: time="2026-10-15T06:19:49.293Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-15T06:19:59.103" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:49.283" grpc.time_ms=9.069 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 242.956348] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.298Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"90fde8c99c14882deca614d4","created_at":"2026-10-15T06:19:49.295Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-1bc7c0832a864cc2","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"37294504d07e5e0d9776ff1f","job_size_bytes":46,"pid":2506,"job_status":"deduplicated","message":"ProjectCacheWorker JID-90fde8c99c14882deca614d4: deduplicated: until executing","deduplication.type":"until executing"}1838gitlab # [ 242.986247] gitaly[912]: time="2026-10-15T06:19:49.328Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-15T06:19:59.138" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:49.318" grpc.time_ms=9.913 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839gitlab # [ 243.006191] gitaly[912]: time="2026-10-15T06:19:49.348Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-15T06:20:19.236" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.337" grpc.time_ms=11.35 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840gitlab # [ 243.027162] gitaly[912]: time="2026-10-15T06:19:49.369Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-15T06:19:59.182" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-15T06:19:49.362" grpc.time_ms=6.924 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1841gitlab # [ 243.050075] gitaly[912]: time="2026-10-15T06:19:49.392Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:19:59.201" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:49.382" grpc.time_ms=10.092 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab # [ 243.121991] gitaly[912]: time="2026-10-15T06:19:49.464Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-15T06:19:59.282" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.463" grpc.time_ms=0.957 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1843gitlab # [ 243.142971] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.484Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","91054694512521db0ee5a785e3e4f7a6e262ca52 b6a58e71d3a2c27b910b4e1e57499f553f6202f1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2d597618653b95c453d9d145","created_at":"2026-10-15T06:19:46.418Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-ddcc9602ef30418b","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-15T06:19:46.420Z","job_size_bytes":185,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2d597618653b95c453d9d145: done: 0.322225 sec","job_status":"done","queue_duration_s":2.741678,"scheduling_latency_s":2.741692,"gitaly_calls":7,"gitaly_duration_s":0.172478,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.024285,"redis_read_bytes":501,"redis_write_bytes":11941,"redis_cache_calls":9,"redis_cache_duration_s":0.002682,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000939,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5718,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003842,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.008033,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.008789,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.021,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.021,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000478273,"exclusive_lock_hold_duration_s":0.102602705,"duration_s":0.322225,"completed_at":"2026-10-15T06:19:49.483Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026065,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1844gitlab # [ 243.147964] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.486Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"37294504d07e5e0d9776ff1f","created_at":"2026-10-15T06:19:47.598Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:47.626Z","job_size_bytes":46,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-37294504d07e5e0d9776ff1f: start","job_status":"start","queue_duration_s":1.86019,"scheduling_latency_s":1.86023}1845gitlab # [ 243.190804] gitaly[912]: time="2026-10-15T06:19:49.533Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-15T12:19:49.527" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:49.528" grpc.time_ms=4.882 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 243.207857] gitaly[912]: time="2026-10-15T06:19:49.550Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-15T06:20:19.444" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.544" grpc.time_ms=5.282 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1847gitlab # [ 243.229381] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.571Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"37294504d07e5e0d9776ff1f","created_at":"2026-10-15T06:19:47.598Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:47.626Z","job_size_bytes":46,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-37294504d07e5e0d9776ff1f: done: 0.085366 sec","job_status":"done","queue_duration_s":1.86019,"scheduling_latency_s":1.86023,"gitaly_calls":2,"gitaly_duration_s":0.015441,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.005896,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001195,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000628,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002206,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000282159,"duration_s":0.085366,"completed_at":"2026-10-15T06:19:49.571Z","load_balancing_strategy":"primary","db_duration_s":0.009054,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1848gitlab # [ 243.232747] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.572Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"da440f7e3a65a29d1189be46","created_at":"2026-10-15T06:19:47.637Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:47.640Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-da440f7e3a65a29d1189be46: start","job_status":"start","queue_duration_s":1.93239,"scheduling_latency_s":1.932405}1849gitlab # [ 243.268890] gitaly[912]: time="2026-10-15T06:19:49.611Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W diskcache=fb897563-ddf1-4432-b641-e8af89164959 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-15T12:19:49.589" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.590" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1850gitlab # [ 243.269626] gitaly[912]: time="2026-10-15T06:19:49.611Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-15T12:19:49.589" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.590" grpc.time_ms=21.323 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1851gitlab # [ 243.361304] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.702Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"da440f7e3a65a29d1189be46","created_at":"2026-10-15T06:19:47.637Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:47.640Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-da440f7e3a65a29d1189be46: done: 0.129984 sec","job_status":"done","queue_duration_s":1.93239,"scheduling_latency_s":1.932405,"gitaly_calls":1,"gitaly_duration_s":0.065913,"redis_calls":15,"redis_duration_s":0.003836,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000584,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001378,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.024,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.106485881,"duration_s":0.129984,"completed_at":"2026-10-15T06:19:49.702Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1852gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1'1853gitlab # [ 243.401935] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.705Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"73df6aa8cac3aa45e6c8bfd5","created_at":"2026-10-15T06:19:47.731Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:47.733Z","job_size_bytes":23,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-73df6aa8cac3aa45e6c8bfd5: start","job_status":"start","queue_duration_s":1.971563,"scheduling_latency_s":1.971591}1854gitlab # [ 243.403060] gitaly[912]: time="2026-10-15T06:19:49.742Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-15T06:20:19.631" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.732" grpc.time_ms=9.461 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1855gitlab # [ 243.439384] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.781Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"73df6aa8cac3aa45e6c8bfd5","created_at":"2026-10-15T06:19:47.731Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:47.733Z","job_size_bytes":23,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-73df6aa8cac3aa45e6c8bfd5: done: 0.076569 sec","job_status":"done","queue_duration_s":1.971563,"scheduling_latency_s":1.971591,"gitaly_calls":1,"gitaly_duration_s":0.041463,"redis_calls":16,"redis_duration_s":0.004522,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000248,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002058,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076569,"completed_at":"2026-10-15T06:19:49.781Z","load_balancing_strategy":"primary","db_duration_s":0.003387,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1856gitlab # [ 243.453497] nixbot[2629]: {"ts": "2026-10-15T06:19:49.795Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41256 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1\" 200"}1857gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1', in 0.07 seconds)1858gitlab # [ 243.484486] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:49.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f2c438c1a23c39469ee34e92","created_at":"2026-10-15T06:19:48.195Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f32eaca7c0f42d418b9c3cccdf7e6d7d14293d92b0ad0e1ca0fdec2aa893c6b4","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:48.202Z","job_size_bytes":467,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f2c438c1a23c39469ee34e92: start","job_status":"start","queue_duration_s":1.623958,"scheduling_latency_s":1.623993}1859gitlab # [ 243.504110] gitaly[912]: time="2026-10-15T06:19:49.846Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:19.745" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.845" grpc.time_ms=0.556 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860gitlab # [ 243.513640] gitaly[912]: time="2026-10-15T06:19:49.855Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-15T06:19:59.010" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:49.850" grpc.time_ms=5.174 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861gitlab # [ 243.598865] gitaly[912]: time="2026-10-15T06:19:49.941Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-15T06:20:19.839" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.939" grpc.time_ms=1.223 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862gitlab # [ 243.627148] gitaly[912]: time="2026-10-15T06:19:49.969Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=32 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-15T06:20:19.865" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:49.965" grpc.time_ms=3.395 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 243.693332] gitaly[912]: time="2026-10-15T06:19:50.035Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:20:00.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:50.023" grpc.time_ms=11.591 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1864gitlab # [ 244.109809] gitaly[912]: time="2026-10-15T06:19:50.452Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-15T06:20:20.333" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:50.433" grpc.time_ms=18.176 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 244.160078] gitaly[912]: time="2026-10-15T06:19:50.502Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3DKQFJJFPQEBC95J0J78W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-15T06:20:20.387" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:50.487" grpc.time_ms=14.967 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 244.199347] sidekiq-cluster[2506]: {"severity":"WARN","time":"2026-10-15T06:19:50.540Z","class":"CreatePipelineWorker","correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"91054694512521db0ee5a785e3e4f7a6e262ca52","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"91054694512521db0ee5a785e3e4f7a6e262ca52","ref":"refs/heads/master"},"retry":0}1867gitlab # [ 244.218816] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f2c438c1a23c39469ee34e92","created_at":"2026-10-15T06:19:48.195Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f32eaca7c0f42d418b9c3cccdf7e6d7d14293d92b0ad0e1ca0fdec2aa893c6b4","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:48.202Z","job_size_bytes":467,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f2c438c1a23c39469ee34e92: done: 0.734427 sec","job_status":"done","queue_duration_s":1.623958,"scheduling_latency_s":1.623993,"gitaly_calls":7,"gitaly_duration_s":0.140784,"redis_calls":51,"redis_duration_s":0.02146,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00082,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003788,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013233,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002522,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.524544,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000343619,"duration_s":0.734427,"completed_at":"2026-10-15T06:19:50.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045055,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1868gitlab # [ 244.227671] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.562Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c4372f7a-11f1-484d-bb6a-8ad14cf23e7b\"}"],"class":"WebHookWorker","jid":"2538aacfcb50b1e7715f2a4b","created_at":"2026-10-15T06:19:48.312Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:94d1c1fecdb45cdc4caf867e16f6d9d984440f1a2e9b135b28986910187318f2","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:48.316Z","job_size_bytes":1751,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2538aacfcb50b1e7715f2a4b: start","job_status":"start","queue_duration_s":2.245562,"scheduling_latency_s":2.245578}1869gitlab # [ 244.329793] nixbot[2629]: {"ts": "2026-10-15T06:19:50.672Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "18654ad7-79d3-43c5-8399-a67c7b3525cf", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "91054694512521db0ee5a785e3e4f7a6e262ca52", "pr": null}1870gitlab # [ 244.334592] nixbot[2629]: {"ts": "2026-10-15T06:19:50.676Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41268 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1871gitlab # [ 244.351707] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.693Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c4372f7a-11f1-484d-bb6a-8ad14cf23e7b\"}"],"class":"WebHookWorker","jid":"2538aacfcb50b1e7715f2a4b","created_at":"2026-10-15T06:19:48.312Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-8276e3722c844773","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:94d1c1fecdb45cdc4caf867e16f6d9d984440f1a2e9b135b28986910187318f2","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:48.316Z","job_size_bytes":1751,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2538aacfcb50b1e7715f2a4b: done: 0.131492 sec","job_status":"done","queue_duration_s":2.245562,"scheduling_latency_s":2.245578,"redis_calls":19,"redis_duration_s":0.003844,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000855,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000465,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001717,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03686921100000973,"cpu_s":0.081247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000442514,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.131492,"completed_at":"2026-10-15T06:19:50.693Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1872gitlab # [ 244.398167] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.740Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a21b8a5a35948c4bab8b7947","created_at":"2026-10-15T06:19:48.790Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:48.796Z","job_size_bytes":23,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a21b8a5a35948c4bab8b7947: start","job_status":"start","queue_duration_s":1.94334,"scheduling_latency_s":1.943371}1873gitlab # [ 244.412342] gitaly[912]: time="2026-10-15T06:19:50.754Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F3HA76CAYWAHN2KSQWB3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:50.744" grpc.time_ms=10.107 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1874gitlab # [ 244.413924] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 561875gitlab # [ 244.460104] gitaly[912]: time="2026-10-15T06:19:50.801Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F3K4ASYV952SYEK17WN0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:50.794" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1876gitlab # [ 244.460362] gitlab-workhorse[824]: time="2026-10-15T06:19:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671877gitlab # [ 244.460760] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 451878gitlab # [ 244.461413] gitaly[912]: time="2026-10-15T06:19:50.801Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F3K4ASYV952SYEK17WN0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:50.794" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1879gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1'1880gitlab # [ 244.462134] gitaly[912]: time="2026-10-15T06:19:50.801Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F3K4ASYV952SYEK17WN0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:50.794" grpc.time_ms=6.905 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1881gitlab # [ 244.515101] nixbot[2629]: {"ts": "2026-10-15T06:19:50.857Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41272 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1\" 200"}1882gitlab # [ 244.517472] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.859Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a21b8a5a35948c4bab8b7947","created_at":"2026-10-15T06:19:48.790Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:48.796Z","job_size_bytes":23,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a21b8a5a35948c4bab8b7947: done: 0.119698 sec","job_status":"done","queue_duration_s":1.94334,"scheduling_latency_s":1.943371,"redis_calls":10,"redis_duration_s":0.003238,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002299,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000671314,"duration_s":0.119698,"completed_at":"2026-10-15T06:19:50.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017968,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1883gitlab # [ 244.519749] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.862Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b1070954b0e138c461dc16e4","created_at":"2026-10-15T06:19:49.015Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.022Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b1070954b0e138c461dc16e4: start","job_status":"start","queue_duration_s":1.839465,"scheduling_latency_s":1.839482}1884gitlab # [ 244.550980] gitaly[912]: time="2026-10-15T06:19:50.893Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F3NR7NWZB738TYVVHJ5J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:50.882" pid=912 remote_ip="2001:db8:1::1" request_sha=2b1dd8cbc2670d44361421ec179252c46de5885a response_bytes=342 span.kind=server system=grpc1885gitlab # [ 244.551927] gitaly[912]: time="2026-10-15T06:19:50.893Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1190 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F3NR7NWZB738TYVVHJ5J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:50.882" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1886gitlab # [ 244.554103] gitlab-workhorse[824]: time="2026-10-15T06:19:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3421887gitlab # [ 244.555843] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 342 "" "git/2.55.0" 521888gitlab # [ 244.557621] gitaly[912]: time="2026-10-15T06:19:50.893Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1190 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F3NR7NWZB738TYVVHJ5J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:50.882" grpc.time_ms=11.265 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1889gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1', in 0.13 seconds)1890gitlab # [ 244.622462] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.964Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b1070954b0e138c461dc16e4","created_at":"2026-10-15T06:19:49.015Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.022Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b1070954b0e138c461dc16e4: done: 0.102481 sec","job_status":"done","queue_duration_s":1.839465,"scheduling_latency_s":1.839482,"redis_calls":10,"redis_duration_s":0.001683,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209803,"duration_s":0.102481,"completed_at":"2026-10-15T06:19:50.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003535,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1891gitlab # [ 244.623306] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.965Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e88fcbbde65233f3a8ba0108","created_at":"2026-10-15T06:19:49.040Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.047Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e88fcbbde65233f3a8ba0108: start","job_status":"start","queue_duration_s":1.918679,"scheduling_latency_s":1.918693}1892gitlab # [ 244.644341] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.986Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e88fcbbde65233f3a8ba0108","created_at":"2026-10-15T06:19:49.040Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.047Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e88fcbbde65233f3a8ba0108: done: 0.020972 sec","job_status":"done","queue_duration_s":1.918679,"scheduling_latency_s":1.918693,"redis_calls":10,"redis_duration_s":0.001216,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195835,"duration_s":0.020972,"completed_at":"2026-10-15T06:19:50.986Z","load_balancing_strategy":"primary","db_duration_s":0.002863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1893gitlab # [ 244.691133] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:50.987Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f58ae4cac87abddef09dc09f","created_at":"2026-10-15T06:19:49.063Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.068Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f58ae4cac87abddef09dc09f: start","job_status":"start","queue_duration_s":1.919397,"scheduling_latency_s":1.91941}1894gitlab # [ 244.691744] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.009Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f58ae4cac87abddef09dc09f","created_at":"2026-10-15T06:19:49.063Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.068Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f58ae4cac87abddef09dc09f: done: 0.021695 sec","job_status":"done","queue_duration_s":1.919397,"scheduling_latency_s":1.91941,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000228,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000344,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214273,"duration_s":0.021695,"completed_at":"2026-10-15T06:19:51.009Z","load_balancing_strategy":"primary","db_duration_s":0.003069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1895gitlab # [ 244.744752] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.010Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3c38e1f97d86b9514faaae37","created_at":"2026-10-15T06:19:49.068Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.073Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3c38e1f97d86b9514faaae37: start","job_status":"start","queue_duration_s":1.936313,"scheduling_latency_s":1.936326}1896gitlab # [ 244.746262] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.028Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3c38e1f97d86b9514faaae37","created_at":"2026-10-15T06:19:49.068Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.073Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3c38e1f97d86b9514faaae37: done: 0.018494 sec","job_status":"done","queue_duration_s":1.936313,"scheduling_latency_s":1.936326,"redis_calls":10,"redis_duration_s":0.001189,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190527,"duration_s":0.018494,"completed_at":"2026-10-15T06:19:51.028Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1897gitlab # [ 244.786267] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.029Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9550cdab3cd1b587f7c5638c","created_at":"2026-10-15T06:19:49.074Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.078Z","job_size_bytes":19,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9550cdab3cd1b587f7c5638c: start","job_status":"start","queue_duration_s":1.951327,"scheduling_latency_s":1.95134}1898gitlab # [ 244.825987] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9550cdab3cd1b587f7c5638c","created_at":"2026-10-15T06:19:49.074Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.078Z","job_size_bytes":19,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9550cdab3cd1b587f7c5638c: done: 0.017558 sec","job_status":"done","queue_duration_s":1.951327,"scheduling_latency_s":1.95134,"redis_calls":11,"redis_duration_s":0.0014980000000000002,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196393,"duration_s":0.017558,"completed_at":"2026-10-15T06:19:51.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0022,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1899gitlab # [ 244.872858] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.047Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b5c7ad4b6878f259909ebd44","created_at":"2026-10-15T06:19:49.080Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.083Z","job_size_bytes":66,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b5c7ad4b6878f259909ebd44: start","job_status":"start","queue_duration_s":1.964372,"scheduling_latency_s":1.964385}1900gitlab # [ 244.873587] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.147Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b5c7ad4b6878f259909ebd44","created_at":"2026-10-15T06:19:49.080Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.083Z","job_size_bytes":66,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b5c7ad4b6878f259909ebd44: done: 0.099836 sec","job_status":"done","queue_duration_s":1.964372,"scheduling_latency_s":1.964385,"redis_calls":10,"redis_duration_s":0.001591,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000378,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.08,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230197,"duration_s":0.099836,"completed_at":"2026-10-15T06:19:51.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.080466,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1901gitlab # [ 244.897248] nixbot[2629]: {"ts": "2026-10-15T06:19:51.164Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1902gitlab # [ 244.899474] nixbot[2629]: {"ts": "2026-10-15T06:19:51.165Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "91054694512521db0ee5a785e3e4f7a6e262ca52"}1903gitlab # [ 244.938506] gitaly[912]: time="2026-10-15T06:19:51.226Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F40CCQ4XD5VX31P1D7CQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:21.024" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.225" grpc.time_ms=0.896 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1904gitlab # [ 244.939315] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.148Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"99ac6060a458db53a84581fd","created_at":"2026-10-15T06:19:49.084Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.086Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-99ac6060a458db53a84581fd: start","job_status":"start","queue_duration_s":2.061906,"scheduling_latency_s":2.06192}1905gitlab # [ 244.939878] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.178Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"99ac6060a458db53a84581fd","created_at":"2026-10-15T06:19:49.084Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.086Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-99ac6060a458db53a84581fd: done: 0.029727 sec","job_status":"done","queue_duration_s":2.061906,"scheduling_latency_s":2.06192,"redis_calls":10,"redis_duration_s":0.003051,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256458,"duration_s":0.029727,"completed_at":"2026-10-15T06:19:51.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1906gitlab # [ 244.990028] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.179Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"bb8a1254deded6f6d1d53821","created_at":"2026-10-15T06:19:49.091Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.093Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-bb8a1254deded6f6d1d53821: start","job_status":"start","queue_duration_s":2.085647,"scheduling_latency_s":2.085662}1907gitlab # [ 244.990716] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.207Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"bb8a1254deded6f6d1d53821","created_at":"2026-10-15T06:19:49.091Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.093Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-bb8a1254deded6f6d1d53821: done: 0.028401 sec","job_status":"done","queue_duration_s":2.085647,"scheduling_latency_s":2.085662,"redis_calls":10,"redis_duration_s":0.001447,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000233829,"duration_s":0.028401,"completed_at":"2026-10-15T06:19:51.207Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1908gitlab # [ 245.044756] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.209Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"27e593b4917b1a223020d3cb","created_at":"2026-10-15T06:19:49.094Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.096Z","job_size_bytes":6,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-27e593b4917b1a223020d3cb: start","job_status":"start","queue_duration_s":2.112075,"scheduling_latency_s":2.112089}1909gitlab # [ 245.045562] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.226Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"27e593b4917b1a223020d3cb","created_at":"2026-10-15T06:19:49.094Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.096Z","job_size_bytes":6,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-27e593b4917b1a223020d3cb: done: 0.017765 sec","job_status":"done","queue_duration_s":2.112075,"scheduling_latency_s":2.112089,"redis_calls":10,"redis_duration_s":0.003365,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00062,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000274058,"duration_s":0.017765,"completed_at":"2026-10-15T06:19:51.226Z","load_balancing_strategy":"primary","db_duration_s":0.001532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1910gitlab # [ 245.076693] gitaly[912]: time="2026-10-15T06:19:51.348Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 diskcache=aaf4b45c-df59-4276-a519-b20b67a4ea40 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-15T12:19:51.335" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.336" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab # [ 245.116048] gitaly[912]: time="2026-10-15T06:19:51.348Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-15T12:19:51.335" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.336" grpc.time_ms=12.418 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912gitlab # [ 245.116446] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.228Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"c0ca451b6f47b227466a72d9","created_at":"2026-10-15T06:19:49.097Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.100Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-c0ca451b6f47b227466a72d9: start","job_status":"start","queue_duration_s":2.127997,"scheduling_latency_s":2.128011}1913gitlab # [ 245.117055] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.251Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"c0ca451b6f47b227466a72d9","created_at":"2026-10-15T06:19:49.097Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.100Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-c0ca451b6f47b227466a72d9: done: 0.023407 sec","job_status":"done","queue_duration_s":2.127997,"scheduling_latency_s":2.128011,"redis_calls":10,"redis_duration_s":0.001332,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190247,"duration_s":0.023407,"completed_at":"2026-10-15T06:19:51.251Z","load_balancing_strategy":"primary","db_duration_s":0.005295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1914gitlab # [ 245.170834] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/91054694512521db0ee5a785e3e4f7a6e262ca52 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2531915gitlab # [ 245.171679] gitaly[912]: time="2026-10-15T06:19:51.360Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F40CCQ4XD5VX31P1D7CQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:20:01.015" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:51.355" grpc.time_ms=4.974 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916gitlab # [ 245.172451] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.252Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"37684b47a1421f1cec40e50a","created_at":"2026-10-15T06:19:49.104Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.107Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-37684b47a1421f1cec40e50a: start","job_status":"start","queue_duration_s":2.144962,"scheduling_latency_s":2.144975}1917gitlab # [ 245.178218] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.294Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"37684b47a1421f1cec40e50a","created_at":"2026-10-15T06:19:49.104Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.107Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-37684b47a1421f1cec40e50a: done: 0.042211 sec","job_status":"done","queue_duration_s":2.144962,"scheduling_latency_s":2.144975,"redis_calls":14,"redis_duration_s":0.007842,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004552,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000803454,"duration_s":0.042211,"completed_at":"2026-10-15T06:19:51.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1918gitlab # [ 245.236850] gitaly[912]: time="2026-10-15T06:19:51.378Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:21.277" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.378" grpc.time_ms=0.697 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 245.238264] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.296Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"084507283fb6a05f74b25d5d","created_at":"2026-10-15T06:19:49.154Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.155Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-084507283fb6a05f74b25d5d: start","job_status":"start","queue_duration_s":2.141299,"scheduling_latency_s":2.141313}1920gitlab # [ 245.242955] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.316Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"084507283fb6a05f74b25d5d","created_at":"2026-10-15T06:19:49.154Z","trace_propagation_headers":{"sentry-trace":"875d4b9825014933b4e737e2e0fec69d-d4b1e967736b4061","baggage":"sentry-trace_id=875d4b9825014933b4e737e2e0fec69d,sentry-release=Unknown"},"correlation_id":"01M4Z3DRSP7GENE7TQSE7DRQFA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.155Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-084507283fb6a05f74b25d5d: done: 0.019791 sec","job_status":"done","queue_duration_s":2.141299,"scheduling_latency_s":2.141313,"redis_calls":8,"redis_duration_s":0.0013280000000000002,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019791,"completed_at":"2026-10-15T06:19:51.316Z","load_balancing_strategy":"primary","db_duration_s":0.00414,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1921gitlab # [ 245.304334] gitaly[912]: time="2026-10-15T06:19:51.385Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-15T06:20:01.199" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:51.380" grpc.time_ms=4.626 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922gitlab # [ 245.304924] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/91054694512521db0ee5a785e3e4f7a6e262ca52 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1701923gitlab # [ 245.307062] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.317Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cbed0405f679e194bddea71f","created_at":"2026-10-15T06:19:49.306Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-1bc7c0832a864cc2","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"da440f7e3a65a29d1189be46","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.308Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cbed0405f679e194bddea71f: start","job_status":"start","queue_duration_s":2.00857,"scheduling_latency_s":2.008591}1924gitlab # [ 245.310674] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.360Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cbed0405f679e194bddea71f","created_at":"2026-10-15T06:19:49.306Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-1bc7c0832a864cc2","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"da440f7e3a65a29d1189be46","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.308Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cbed0405f679e194bddea71f: done: 0.04343 sec","job_status":"done","queue_duration_s":2.00857,"scheduling_latency_s":2.008591,"gitaly_calls":1,"gitaly_duration_s":0.018105,"redis_calls":12,"redis_duration_s":0.002229,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000468,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.028644143,"duration_s":0.04343,"completed_at":"2026-10-15T06:19:51.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1925gitlab # [ 245.370319] gitaly[912]: time="2026-10-15T06:19:51.412Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-15T06:20:21.311" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.412" grpc.time_ms=0.595 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926gitlab # [ 245.371133] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/91054694512521db0ee5a785e3e4f7a6e262ca52 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 911927gitlab # [ 245.371611] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.362Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"97bdbbbd4b43cfa907a44f26","created_at":"2026-10-15T06:19:49.441Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-1bc7c0832a864cc2","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d6c6fc07fee951de0cc013611a4fe5796cc60e436b60649315e3ce870cdd10e4","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.442Z","job_size_bytes":467,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-97bdbbbd4b43cfa907a44f26: start","job_status":"start","queue_duration_s":1.919088,"scheduling_latency_s":1.919105}1928gitlab # [ 245.411256] gitaly[912]: time="2026-10-15T06:19:51.419Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-15T06:20:21.314" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.415" grpc.time_ms=3.622 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1929gitlab # [ 245.411941] gitaly[912]: time="2026-10-15T06:19:51.442Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:20:01.257" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:51.437" grpc.time_ms=4.987 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930gitlab # [ 245.412579] gitaly[912]: time="2026-10-15T06:19:51.541Z" level=info msg="finished unary call with code OK" catfile.duration_ms=69 catfile.flush_count=1 catfile.flush_ms=4 catfile.read_object_count=1 catfile.read_object_ms=65 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F48EW4Y8D4CZ9PESPPAD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:21.270" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.471" grpc.time_ms=70.32 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 245.419053] gitaly[912]: time="2026-10-15T06:19:51.570Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F48EW4Y8D4CZ9PESPPAD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:20:01.224" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:51.565" grpc.time_ms=4.92 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 245.459244] gitaly[912]: time="2026-10-15T06:19:51.642Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F4DXQQBJK35FVZFEE7JK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:21.441" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.642" grpc.time_ms=0.429 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 245.460209] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421934gitlab # [ 245.460728] gitaly[912]: time="2026-10-15T06:19:51.677Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F4DXQQBJK35FVZFEE7JK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:20:01.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:51.666" grpc.time_ms=10.369 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935gitlab # [ 245.461973] gitaly[912]: time="2026-10-15T06:19:51.770Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F4HGTPE7AJ8YQYEHEGK0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:51.760" grpc.time_ms=10.086 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1936gitlab # [ 245.467945] gitaly[912]: time="2026-10-15T06:19:51.794Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-15T06:20:21.684" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.785" grpc.time_ms=8.567 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 245.481981] gitaly[912]: time="2026-10-15T06:19:51.804Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3EZ0FCR0AAW64DZ481MP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-15T06:20:21.696" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:51.796" grpc.time_ms=7.781 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 245.530827] sidekiq-cluster[2506]: {"severity":"WARN","time":"2026-10-15T06:19:51.813Z","class":"CreatePipelineWorker","correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"91054694512521db0ee5a785e3e4f7a6e262ca52","after":"b6a58e71d3a2c27b910b4e1e57499f553f6202f1","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"b6a58e71d3a2c27b910b4e1e57499f553f6202f1","ref":"refs/heads/master"},"retry":0}1939gitlab # [ 245.531671] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.819Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"97bdbbbd4b43cfa907a44f26","created_at":"2026-10-15T06:19:49.441Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-1bc7c0832a864cc2","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d6c6fc07fee951de0cc013611a4fe5796cc60e436b60649315e3ce870cdd10e4","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.442Z","job_size_bytes":467,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-97bdbbbd4b43cfa907a44f26: done: 0.457025 sec","job_status":"done","queue_duration_s":1.919088,"scheduling_latency_s":1.919105,"gitaly_calls":7,"gitaly_duration_s":0.042812,"redis_calls":33,"redis_duration_s":0.006036,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000575,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001309,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001817,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.39121,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.457025,"completed_at":"2026-10-15T06:19:51.819Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016249,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1940gitlab # [ 245.545733] nixbot[2629]: {"ts": "2026-10-15T06:19:51.841Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "55d729bf-c3f0-45f8-9720-7afd4e1d9480", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "b6a58e71d3a2c27b910b4e1e57499f553f6202f1", "pr": null}1941gitlab # [ 245.548860] nixbot[2629]: {"ts": "2026-10-15T06:19:51.844Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41286 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1942gitlab # [ 245.550571] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.821Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"60efea6e-6fb4-4db5-af05-f016352546ad\"}"],"class":"WebHookWorker","jid":"c005731567ae8fe102a1aadd","created_at":"2026-10-15T06:19:49.453Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-1bc7c0832a864cc2","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fa1a2b8523d79d685337c28e73eda8c325bd4a67915d04600f0ac307399990f9","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.454Z","job_size_bytes":1749,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c005731567ae8fe102a1aadd: start","job_status":"start","queue_duration_s":2.367462,"scheduling_latency_s":2.367479}1943gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1'1944gitlab # [ 245.566639] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.849Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"60efea6e-6fb4-4db5-af05-f016352546ad\"}"],"class":"WebHookWorker","jid":"c005731567ae8fe102a1aadd","created_at":"2026-10-15T06:19:49.453Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-1bc7c0832a864cc2","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fa1a2b8523d79d685337c28e73eda8c325bd4a67915d04600f0ac307399990f9","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.454Z","job_size_bytes":1749,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c005731567ae8fe102a1aadd: done: 0.028033 sec","job_status":"done","queue_duration_s":2.367462,"scheduling_latency_s":2.367479,"redis_calls":14,"redis_duration_s":0.004162,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000465,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002711,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.004985270000020137,"cpu_s":0.014633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.028033,"completed_at":"2026-10-15T06:19:51.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1945gitlab # [ 245.617836] gitaly[912]: time="2026-10-15T06:19:51.921Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F4JVAERPYZ1VSNKQW6C3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:51.911" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1946gitlab # [ 245.618296] gitlab-workhorse[824]: time="2026-10-15T06:19:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671947gitlab # [ 245.622188] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1501948gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1', in 0.05 seconds)1949gitlab # [ 245.622775] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.850Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"7c87e2160cb848bbb937b188","created_at":"2026-10-15T06:19:49.559Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-293f539a09704c5c","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.563Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-7c87e2160cb848bbb937b188: start","job_status":"start","queue_duration_s":2.287549,"scheduling_latency_s":2.287564}1950gitlab # [ 245.635746] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"7c87e2160cb848bbb937b188","created_at":"2026-10-15T06:19:49.559Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-293f539a09704c5c","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:49.563Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-7c87e2160cb848bbb937b188: done: 0.039903 sec","job_status":"done","queue_duration_s":2.287549,"scheduling_latency_s":2.287564,"redis_calls":19,"redis_duration_s":0.010734,"redis_read_bytes":21,"redis_write_bytes":4289,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002703,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000641,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2260,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.006266,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.013320688,"duration_s":0.039903,"completed_at":"2026-10-15T06:19:51.890Z","load_balancing_strategy":"primary","db_duration_s":0.007201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1951gitlab # [ 245.676670] gitaly[912]: time="2026-10-15T06:19:51.921Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F4JVAERPYZ1VSNKQW6C3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:51.911" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1952gitlab # [ 245.719764] nixbot[2629]: {"ts": "2026-10-15T06:19:51.995Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41296 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1\" 200"}1953gitlab # [ 245.720647] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.893Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2538aacfcb50b1e7715f2a4b"],"class":"WebHooks::LogExecutionWorker","jid":"3858fff9f0d5204cdd220c2d","created_at":"2026-10-15T06:19:50.680Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-bb6e7be432eb40ea","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d8495f2231e2171142dd436f737aee05f210a0b869f41dcfcffba746a13bfd29","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:50.686Z","job_size_bytes":2593,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3858fff9f0d5204cdd220c2d: start","job_status":"start","queue_duration_s":1.20637,"scheduling_latency_s":1.206386}1954gitlab # [ 245.721422] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.931Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2538aacfcb50b1e7715f2a4b"],"class":"WebHooks::LogExecutionWorker","jid":"3858fff9f0d5204cdd220c2d","created_at":"2026-10-15T06:19:50.680Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-bb6e7be432eb40ea","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d8495f2231e2171142dd436f737aee05f210a0b869f41dcfcffba746a13bfd29","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:50.686Z","job_size_bytes":2593,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3858fff9f0d5204cdd220c2d: done: 0.03793 sec","job_status":"done","queue_duration_s":1.20637,"scheduling_latency_s":1.206386,"redis_calls":10,"redis_duration_s":0.003663,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222934,"duration_s":0.03793,"completed_at":"2026-10-15T06:19:51.931Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009182,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1955gitlab # [ 245.777795] gitaly[912]: time="2026-10-15T06:19:51.921Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F4JVAERPYZ1VSNKQW6C3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:51.911" grpc.time_ms=9.867 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1956gitlab # [ 245.778830] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 821957gitlab # [ 245.779540] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:51.932Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b56c6c67951cf78aedb0e3cf","created_at":"2026-10-15T06:19:51.417Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-07968d4e507c4ec7","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:51.421Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b56c6c67951cf78aedb0e3cf: start","job_status":"start","queue_duration_s":0.510978,"scheduling_latency_s":0.510993}1958gitlab # [ 245.780159] gitaly[912]: time="2026-10-15T06:19:52.027Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=6 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F4R8T0142WXYMNZ15QSH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:51.997" grpc.time_ms=30.182 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1959gitlab # [ 245.790651] gitaly[912]: time="2026-10-15T06:19:52.059Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F40CCQ4XD5VX31P1D7CQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:52.058" grpc.time_ms=0.678 pid=912 span.kind=server system=grpc1960gitlab # [ 245.836538] gitaly[912]: time="2026-10-15T06:19:52.089Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F40CCQ4XD5VX31P1D7CQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:52.089" grpc.time_ms=0.311 pid=912 span.kind=server system=grpc1961gitlab # [ 245.837186] gitaly[912]: time="2026-10-15T06:19:52.107Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F40CCQ4XD5VX31P1D7CQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:52.107" grpc.time_ms=0.286 pid=912 span.kind=server system=grpc1962gitlab # [ 245.837892] gitlab-workhorse[824]: time="2026-10-15T06:19:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671963gitlab # [ 245.838690] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1071964gitlab # [ 245.839555] gitaly[912]: time="2026-10-15T06:19:52.117Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F40CCQ4XD5VX31P1D7CQ diskcache=aaa3771c-d639-4457-97ee-2b7685979010 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:21.897" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:51.997" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1965gitlab # [ 245.840027] gitaly[912]: time="2026-10-15T06:19:52.117Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=61 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7395 command.oublock=0 command.real_time_ms=112 command.spawn_token_fork_ms=1 command.system_time_ms=39 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F40CCQ4XD5VX31P1D7CQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:21.897" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:51.997" grpc.time_ms=119.277 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 245.840687] gitaly[912]: time="2026-10-15T06:19:52.134Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F4TWRHPR45EA0A6ADBQ7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.125" pid=912 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1967gitlab # [ 245.886841] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.203Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b56c6c67951cf78aedb0e3cf","created_at":"2026-10-15T06:19:51.417Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-07968d4e507c4ec7","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:51.421Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2506,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b56c6c67951cf78aedb0e3cf: rescheduled"}1968gitlab # [ 245.887662] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.208Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b56c6c67951cf78aedb0e3cf","created_at":"2026-10-15T06:19:51.417Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-07968d4e507c4ec7","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:51.421Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b56c6c67951cf78aedb0e3cf: done: 0.276362 sec","job_status":"done","queue_duration_s":0.510978,"scheduling_latency_s":0.510993,"gitaly_calls":3,"gitaly_duration_s":0.128235,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018956999999999998,"redis_read_bytes":148,"redis_write_bytes":18011,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000281,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000923,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.005768,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12310,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.009429,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000143,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00072,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001412,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083632,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.250287676,"duration_s":0.276362,"completed_at":"2026-10-15T06:19:52.208Z","load_balancing_strategy":"primary","db_duration_s":0.035852,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1969gitlab # [ 245.909630] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 561970gitlab # [ 245.911197] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 571971gitlab # [ 245.913073] gitaly[912]: time="2026-10-15T06:19:52.134Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F4TWRHPR45EA0A6ADBQ7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.125" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1972gitlab # [ 245.962158] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.209Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c005731567ae8fe102a1aadd"],"class":"WebHooks::LogExecutionWorker","jid":"7ac772ce6fc5c11eaeaf554f","created_at":"2026-10-15T06:19:51.844Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-3cf4b44a8aea4259","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a1777f0cb2f0fa95d49196ee613708d052dd4c00287eafd83b65c5504cfc9fb3","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:51.846Z","job_size_bytes":2592,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7ac772ce6fc5c11eaeaf554f: start","job_status":"start","queue_duration_s":0.363535,"scheduling_latency_s":0.363551}1973gitlab # [ 245.962865] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.228Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c005731567ae8fe102a1aadd"],"class":"WebHooks::LogExecutionWorker","jid":"7ac772ce6fc5c11eaeaf554f","created_at":"2026-10-15T06:19:51.844Z","trace_propagation_headers":{"sentry-trace":"0b908d247910430fa2f40a2352b5ca53-3cf4b44a8aea4259","baggage":"sentry-trace_id=0b908d247910430fa2f40a2352b5ca53,sentry-release=Unknown"},"correlation_id":"01M4Z3EZ0FCR0AAW64DZ481MP0","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a1777f0cb2f0fa95d49196ee613708d052dd4c00287eafd83b65c5504cfc9fb3","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:51.846Z","job_size_bytes":2592,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7ac772ce6fc5c11eaeaf554f: done: 0.019014 sec","job_status":"done","queue_duration_s":0.363535,"scheduling_latency_s":0.363551,"redis_calls":7,"redis_duration_s":0.001192,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019014,"completed_at":"2026-10-15T06:19:52.228Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003296,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1974gitlab # [ 246.014616] gitlab-workhorse[824]: time="2026-10-15T06:19:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671975gitlab # [ 246.015202] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 671976gitlab # [ 246.015882] gitlab-workhorse[824]: time="2026-10-15T06:19:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2211977gitlab # [ 246.020089] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 941978gitlab # [ 246.020781] gitaly[912]: time="2026-10-15T06:19:52.134Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F4TWRHPR45EA0A6ADBQ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.125" grpc.time_ms=8.56 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1979gitlab # [ 246.021449] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.235Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"2da33b40fc858d62a358c398","created_at":"2026-10-15T06:19:51.872Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-d0453f0b956540dd","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:51.883Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-2da33b40fc858d62a358c398: start","job_status":"start","queue_duration_s":0.35159,"scheduling_latency_s":0.351615}1980gitlab # [ 246.024703] gitaly[912]: time="2026-10-15T06:19:52.164Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F40CCQ4XD5VX31P1D7CQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-15T06:20:22.063" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:52.163" grpc.time_ms=0.548 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 246.025773] gitaly[912]: time="2026-10-15T06:19:52.196Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F40CCQ4XD5VX31P1D7CQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:22.095" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:52.196" grpc.time_ms=0.57 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 246.073871] gitaly[912]: time="2026-10-15T06:19:52.215Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F4YY9X93MQ5R33W6EH08 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.207" grpc.time_ms=7.62 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1983gitlab # [ 246.074461] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.382Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"2da33b40fc858d62a358c398","created_at":"2026-10-15T06:19:51.872Z","trace_propagation_headers":{"sentry-trace":"5d803a7875f14aca8a9f792944028955-d0453f0b956540dd","baggage":"sentry-trace_id=5d803a7875f14aca8a9f792944028955,sentry-release=Unknown"},"correlation_id":"01M4Z3DKQFJJFPQEBC95J0J78W","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:51.883Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-2da33b40fc858d62a358c398: done: 0.147176 sec","job_status":"done","queue_duration_s":0.35159,"scheduling_latency_s":0.351615,"redis_calls":11,"redis_duration_s":0.00444,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00159,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002055,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024165,"duration_s":0.147176,"completed_at":"2026-10-15T06:19:52.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1984gitlab # [ 246.090197] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.383Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"86f8eba2302c56ee43b7580a","created_at":"2026-10-15T06:19:51.980Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:51.986Z","job_size_bytes":23,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-86f8eba2302c56ee43b7580a: start","job_status":"start","queue_duration_s":0.397634,"scheduling_latency_s":0.397649}1985gitlab # [ 246.105633] gitaly[912]: time="2026-10-15T06:19:52.228Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F4ZAR0Z3MV027ACKP3S9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.212" grpc.time_ms=15.259 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1986gitlab # [ 246.145728] gitaly[912]: time="2026-10-15T06:19:52.283Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F50SRNKADHHBWGCJ27XA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.275" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1987gitlab # [ 246.146721] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"86f8eba2302c56ee43b7580a","created_at":"2026-10-15T06:19:51.980Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:51.986Z","job_size_bytes":23,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-86f8eba2302c56ee43b7580a: done: 0.028251 sec","job_status":"done","queue_duration_s":0.397634,"scheduling_latency_s":0.397649,"redis_calls":7,"redis_duration_s":0.002294,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028251,"completed_at":"2026-10-15T06:19:52.411Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005919,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1988gitlab # [ 246.165141] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.413Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a00f4f1734679cc2918f44e2","created_at":"2026-10-15T06:19:52.121Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.123Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a00f4f1734679cc2918f44e2: start","job_status":"start","queue_duration_s":0.289941,"scheduling_latency_s":0.289956}1989gitlab # [ 246.180619] gitaly[912]: time="2026-10-15T06:19:52.283Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F50SRNKADHHBWGCJ27XA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.275" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1990gitlab # [ 246.227712] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.435Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a00f4f1734679cc2918f44e2","created_at":"2026-10-15T06:19:52.121Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.123Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a00f4f1734679cc2918f44e2: done: 0.022117 sec","job_status":"done","queue_duration_s":0.289941,"scheduling_latency_s":0.289956,"redis_calls":7,"redis_duration_s":0.0034289999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001796,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022117,"completed_at":"2026-10-15T06:19:52.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 246.232970] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.437Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"49ec1a116f4fc73baffcd598","created_at":"2026-10-15T06:19:52.134Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.137Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-49ec1a116f4fc73baffcd598: start","job_status":"start","queue_duration_s":0.299294,"scheduling_latency_s":0.29932}1992gitlab # [ 246.247481] gitaly[912]: time="2026-10-15T06:19:52.284Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F50SRNKADHHBWGCJ27XA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.275" grpc.time_ms=8.722 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1993gitlab # [ 246.262149] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.462Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"49ec1a116f4fc73baffcd598","created_at":"2026-10-15T06:19:52.134Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.137Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-49ec1a116f4fc73baffcd598: done: 0.025038 sec","job_status":"done","queue_duration_s":0.299294,"scheduling_latency_s":0.29932,"redis_calls":7,"redis_duration_s":0.001092,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025038,"completed_at":"2026-10-15T06:19:52.462Z","load_balancing_strategy":"primary","db_duration_s":0.004639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1994gitlab # [ 246.312957] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.463Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b44138dd3ae0b48641ed72f0","created_at":"2026-10-15T06:19:52.144Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.147Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b44138dd3ae0b48641ed72f0: start","job_status":"start","queue_duration_s":0.316024,"scheduling_latency_s":0.316039}1995gitlab # [ 246.313783] gitaly[912]: time="2026-10-15T06:19:52.323Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F5157EKH118863S27GFT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.310" pid=912 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc1996gitlab # [ 246.322564] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.483Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b44138dd3ae0b48641ed72f0","created_at":"2026-10-15T06:19:52.144Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.147Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b44138dd3ae0b48641ed72f0: done: 0.020633 sec","job_status":"done","queue_duration_s":0.316024,"scheduling_latency_s":0.316039,"redis_calls":10,"redis_duration_s":0.001459,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000438,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020633,"completed_at":"2026-10-15T06:19:52.483Z","load_balancing_strategy":"primary","db_duration_s":0.003376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 246.387645] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.484Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"65cab4781331bf0181907473","created_at":"2026-10-15T06:19:52.147Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.148Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-65cab4781331bf0181907473: start","job_status":"start","queue_duration_s":0.336141,"scheduling_latency_s":0.336157}1998gitlab # [ 246.388501] gitaly[912]: time="2026-10-15T06:19:52.323Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F5157EKH118863S27GFT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.310" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc1999gitlab # [ 246.390230] nixbot[2629]: {"ts": "2026-10-15T06:19:52.723Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-b6a58e71d3a2-6"}2000gitlab # [ 246.392592] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.504Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"65cab4781331bf0181907473","created_at":"2026-10-15T06:19:52.147Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.148Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-65cab4781331bf0181907473: done: 0.020092 sec","job_status":"done","queue_duration_s":0.336141,"scheduling_latency_s":0.336157,"redis_calls":7,"redis_duration_s":0.001836,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020092,"completed_at":"2026-10-15T06:19:52.504Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2001gitlab # [ 246.445173] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.505Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0461110e987aac5581de8677","created_at":"2026-10-15T06:19:52.149Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.150Z","job_size_bytes":19,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0461110e987aac5581de8677: start","job_status":"start","queue_duration_s":0.355469,"scheduling_latency_s":0.355484}2002gitlab # [ 246.447335] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3562003gitlab # [ 246.449732] gitaly[912]: time="2026-10-15T06:19:52.324Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F5157EKH118863S27GFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:52.310" grpc.time_ms=13.441 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2004gitlab # [ 246.463158] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.521Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0461110e987aac5581de8677","created_at":"2026-10-15T06:19:52.149Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.150Z","job_size_bytes":19,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0461110e987aac5581de8677: done: 0.015737 sec","job_status":"done","queue_duration_s":0.355469,"scheduling_latency_s":0.355484,"redis_calls":8,"redis_duration_s":0.001095,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015737,"completed_at":"2026-10-15T06:19:52.521Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2005gitlab # [ 246.528027] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.522Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9708848587ded8feaca37a5d","created_at":"2026-10-15T06:19:52.151Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.152Z","job_size_bytes":66,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9708848587ded8feaca37a5d: start","job_status":"start","queue_duration_s":0.370232,"scheduling_latency_s":0.370249}2006gitlab # [ 246.528868] gitaly[912]: time="2026-10-15T06:19:52.412Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:22.411" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:52.412" grpc.time_ms=0.792 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 246.529624] nixbot[2629]: {"ts": "2026-10-15T06:19:52.822Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-b6a58e71d3a2-6", "argv0": "bwrap"}2008gitlab # [ 246.531073] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.536Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9708848587ded8feaca37a5d","created_at":"2026-10-15T06:19:52.151Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.152Z","job_size_bytes":66,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9708848587ded8feaca37a5d: done: 0.014338 sec","job_status":"done","queue_duration_s":0.370232,"scheduling_latency_s":0.370249,"redis_calls":7,"redis_duration_s":0.0009350000000000001,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014338,"completed_at":"2026-10-15T06:19:52.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2009gitlab # [ 246.572798] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.537Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"321f6f9ddfb9a01e053849a1","created_at":"2026-10-15T06:19:52.152Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.153Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-321f6f9ddfb9a01e053849a1: start","job_status":"start","queue_duration_s":0.384288,"scheduling_latency_s":0.384302}2010gitlab # [ 246.584307] gitaly[912]: time="2026-10-15T06:19:52.436Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-15T06:20:22.430" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:52.430" grpc.time_ms=5.987 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1'2012gitlab # [ 246.596620] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.556Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"321f6f9ddfb9a01e053849a1","created_at":"2026-10-15T06:19:52.152Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.153Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-321f6f9ddfb9a01e053849a1: done: 0.018423 sec","job_status":"done","queue_duration_s":0.384288,"scheduling_latency_s":0.384302,"redis_calls":7,"redis_duration_s":0.0013989999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018423,"completed_at":"2026-10-15T06:19:52.556Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003995,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2013gitlab # [ 246.641990] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.558Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f40bb734084ca9e4f2989d7a","created_at":"2026-10-15T06:19:52.153Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.154Z","job_size_bytes":6,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f40bb734084ca9e4f2989d7a: start","job_status":"start","queue_duration_s":0.403326,"scheduling_latency_s":0.403342}2014gitlab # [ 246.647302] gitaly[912]: time="2026-10-15T06:19:52.452Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:20:02.033" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:52.444" grpc.time_ms=8.143 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 246.659110] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.567Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f40bb734084ca9e4f2989d7a","created_at":"2026-10-15T06:19:52.153Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.154Z","job_size_bytes":6,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f40bb734084ca9e4f2989d7a: done: 0.00963 sec","job_status":"done","queue_duration_s":0.403326,"scheduling_latency_s":0.403342,"redis_calls":7,"redis_duration_s":0.0009350000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00963,"completed_at":"2026-10-15T06:19:52.567Z","load_balancing_strategy":"primary","db_duration_s":0.000405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016gitlab # [ 246.719919] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.568Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7158d81aeaecab7a075eb33d","created_at":"2026-10-15T06:19:52.155Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.155Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7158d81aeaecab7a075eb33d: start","job_status":"start","queue_duration_s":0.412708,"scheduling_latency_s":0.412723}2017gitlab # [ 246.720672] gitaly[912]: time="2026-10-15T06:19:52.540Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-15T06:20:02.130" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:52.540" grpc.time_ms=0.25 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018gitlab # [ 246.721523] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.587Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7158d81aeaecab7a075eb33d","created_at":"2026-10-15T06:19:52.155Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.155Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7158d81aeaecab7a075eb33d: done: 0.018687 sec","job_status":"done","queue_duration_s":0.412708,"scheduling_latency_s":0.412723,"redis_calls":7,"redis_duration_s":0.0009780000000000001,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018687,"completed_at":"2026-10-15T06:19:52.587Z","load_balancing_strategy":"primary","db_duration_s":0.003577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2019gitlab # [ 246.759714] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.591Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"64229049553d369a94593414","created_at":"2026-10-15T06:19:52.203Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.205Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-64229049553d369a94593414: start","job_status":"start","queue_duration_s":0.385821,"scheduling_latency_s":0.385848}2020gitlab # [ 246.798029] gitaly[912]: time="2026-10-15T06:19:52.548Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-15T06:20:02.132" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:52.543" grpc.time_ms=5.647 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 246.798714] gitaly[912]: time="2026-10-15T06:19:52.587Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:52.587" grpc.time_ms=0.569 pid=912 span.kind=server system=grpc2022gitlab # [ 246.799534] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.611Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"64229049553d369a94593414","created_at":"2026-10-15T06:19:52.203Z","trace_propagation_headers":{"sentry-trace":"a52255901646451abc101905fc3410d8-2b02523eb9704c5e","baggage":"sentry-trace_id=a52255901646451abc101905fc3410d8,sentry-release=Unknown"},"correlation_id":"01M4Z3F40CCQ4XD5VX31P1D7CQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.205Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-64229049553d369a94593414: done: 0.020456 sec","job_status":"done","queue_duration_s":0.385821,"scheduling_latency_s":0.385848,"redis_calls":8,"redis_duration_s":0.0012129999999999999,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020456,"completed_at":"2026-10-15T06:19:52.611Z","load_balancing_strategy":"primary","db_duration_s":0.003168,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2023gitlab # [ 246.857281] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.632Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7f156c3e3ec64a387416b3a7","created_at":"2026-10-15T06:19:52.628Z","trace_propagation_headers":{"sentry-trace":"1ee69705d726405dbc7137e2052d7ed2-a1f9f809b5bf4628","baggage":"sentry-trace_id=1ee69705d726405dbc7137e2052d7ed2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3F557M5HESSJZQVG4NP3T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.631Z","job_size_bytes":65,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7f156c3e3ec64a387416b3a7: start","job_status":"start","queue_duration_s":0.001175,"scheduling_latency_s":0.001207}2024gitlab # [ 246.857917] gitaly[912]: time="2026-10-15T06:19:52.613Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:52.612" grpc.time_ms=0.286 pid=912 span.kind=server system=grpc2025gitlab # [ 246.858495] gitaly[912]: time="2026-10-15T06:19:52.622Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T diskcache=4d61fbd9-a265-4f2f-8089-f650cda0ee52 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-15T06:20:02.141" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:52.551" pid=912 ref=refs/keep-around/b6a58e71d3a2c27b910b4e1e57499f553f6202f1 remote_ip="2001:db8:1::1" revision=b6a58e71d3a2c27b910b4e1e57499f553f6202f1 span.kind=server system=grpc username=root2026gitlab # [ 246.859125] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.660Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7f156c3e3ec64a387416b3a7","created_at":"2026-10-15T06:19:52.628Z","trace_propagation_headers":{"sentry-trace":"1ee69705d726405dbc7137e2052d7ed2-a1f9f809b5bf4628","baggage":"sentry-trace_id=1ee69705d726405dbc7137e2052d7ed2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3F557M5HESSJZQVG4NP3T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.631Z","job_size_bytes":65,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7f156c3e3ec64a387416b3a7: done: 0.02814 sec","job_status":"done","queue_duration_s":0.001175,"scheduling_latency_s":0.001207,"redis_calls":7,"redis_duration_s":0.004175,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02814,"completed_at":"2026-10-15T06:19:52.660Z","load_balancing_strategy":"primary","db_duration_s":0.003711,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2027gitlab # [ 246.918247] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.666Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"865b1f6bb1b42004fa8d47a5","created_at":"2026-10-15T06:19:52.632Z","trace_propagation_headers":{"sentry-trace":"1ee69705d726405dbc7137e2052d7ed2-a1f9f809b5bf4628","baggage":"sentry-trace_id=1ee69705d726405dbc7137e2052d7ed2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3F557M5HESSJZQVG4NP3T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.635Z","job_size_bytes":65,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-865b1f6bb1b42004fa8d47a5: start","job_status":"start","queue_duration_s":0.030961,"scheduling_latency_s":0.030992}2028gitlab # [ 246.918863] gitaly[912]: time="2026-10-15T06:19:52.622Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=45 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5292 command.oublock=8 command.real_time_ms=60 command.spawn_token_fork_ms=0 command.system_time_ms=30 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-15T06:20:02.141" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-15T06:19:52.551" grpc.time_ms=71.43 pid=912 ref=refs/keep-around/b6a58e71d3a2c27b910b4e1e57499f553f6202f1 remote_ip="2001:db8:1::1" revision=b6a58e71d3a2c27b910b4e1e57499f553f6202f1 span.kind=server system=grpc username=root2029gitlab # [ 246.919758] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.710Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"865b1f6bb1b42004fa8d47a5","created_at":"2026-10-15T06:19:52.632Z","trace_propagation_headers":{"sentry-trace":"1ee69705d726405dbc7137e2052d7ed2-a1f9f809b5bf4628","baggage":"sentry-trace_id=1ee69705d726405dbc7137e2052d7ed2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3F557M5HESSJZQVG4NP3T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.635Z","job_size_bytes":65,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-865b1f6bb1b42004fa8d47a5: done: 0.044189 sec","job_status":"done","queue_duration_s":0.030961,"scheduling_latency_s":0.030992,"redis_calls":10,"redis_duration_s":0.001898,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000729,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044189,"completed_at":"2026-10-15T06:19:52.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2030gitlab # [ 246.973860] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.712Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"41168136d2069f96462c62f7","created_at":"2026-10-15T06:19:52.697Z","trace_propagation_headers":{"sentry-trace":"1ee69705d726405dbc7137e2052d7ed2-a1f9f809b5bf4628","baggage":"sentry-trace_id=1ee69705d726405dbc7137e2052d7ed2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3F557M5HESSJZQVG4NP3T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.700Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-41168136d2069f96462c62f7: start","job_status":"start","queue_duration_s":0.011253,"scheduling_latency_s":0.011275}2031gitlab # [ 246.974723] gitaly[912]: time="2026-10-15T06:19:52.626Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:22.625" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:52.625" grpc.time_ms=0.33 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2032gitlab # [ 246.982546] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"41168136d2069f96462c62f7","created_at":"2026-10-15T06:19:52.697Z","trace_propagation_headers":{"sentry-trace":"1ee69705d726405dbc7137e2052d7ed2-a1f9f809b5bf4628","baggage":"sentry-trace_id=1ee69705d726405dbc7137e2052d7ed2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3F557M5HESSJZQVG4NP3T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.700Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-41168136d2069f96462c62f7: done: 0.087411 sec","job_status":"done","queue_duration_s":0.011253,"scheduling_latency_s":0.011275,"gitaly_calls":2,"gitaly_duration_s":0.007714,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.005496,"redis_read_bytes":79,"redis_write_bytes":5120,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000764,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.0007,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000176,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1131,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000254,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001185,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056459,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.064116249,"duration_s":0.087411,"completed_at":"2026-10-15T06:19:52.799Z","load_balancing_strategy":"primary","db_duration_s":0.020537,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2033gitlab # [ 247.026851] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.800Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"cc567f9b2ab40a1e7ff0e01d","created_at":"2026-10-15T06:19:52.752Z","trace_propagation_headers":{"sentry-trace":"1ee69705d726405dbc7137e2052d7ed2-5f528a3090734849","baggage":"sentry-trace_id=1ee69705d726405dbc7137e2052d7ed2,sentry-release=Unknown"},"correlation_id":"01M4Z3F557M5HESSJZQVG4NP3T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.754Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-cc567f9b2ab40a1e7ff0e01d: start","job_status":"start","queue_duration_s":0.046175,"scheduling_latency_s":0.046189}2034gitlab # [ 247.073036] gitaly[912]: time="2026-10-15T06:19:52.763Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-15T06:20:22.662" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:52.763" grpc.time_ms=0.755 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 247.073806] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:52.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"cc567f9b2ab40a1e7ff0e01d","created_at":"2026-10-15T06:19:52.752Z","trace_propagation_headers":{"sentry-trace":"1ee69705d726405dbc7137e2052d7ed2-5f528a3090734849","baggage":"sentry-trace_id=1ee69705d726405dbc7137e2052d7ed2,sentry-release=Unknown"},"correlation_id":"01M4Z3F557M5HESSJZQVG4NP3T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:52.754Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-cc567f9b2ab40a1e7ff0e01d: done: 0.025875 sec","job_status":"done","queue_duration_s":0.046175,"scheduling_latency_s":0.046189,"redis_calls":7,"redis_duration_s":0.004018,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001913,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025875,"completed_at":"2026-10-15T06:19:52.826Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2036gitlab # [ 247.111606] gitaly[912]: time="2026-10-15T06:19:52.790Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F557M5HESSJZQVG4NP3T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:22.686" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:52.786" grpc.time_ms=3.625 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 247.151702] nixbot[2629]: {"ts": "2026-10-15T06:19:53.493Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41310 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1\" 200"}2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6a58e71d3a2c27b910b4e1e57499f553f6202f1', in 0.49 seconds)2039(finished: subtest: push delivers the webhook, in 47.18 seconds)2040subtest: eval and build post commit statuses2041gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses2042gitlab # [ 247.191400] nix-daemon[2795]: accepted connection from pid 3622, user nixbot2043gitlab # [ 247.236697] gitaly[912]: time="2026-10-15T06:19:53.579Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F69K9D71P203HGYN6WYZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:23.577" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:53.577" grpc.time_ms=0.952 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2044gitlab # [ 247.263219] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 812045gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses, in 0.11 seconds)2046gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses2047gitlab # [ 248.398092] gitaly[912]: time="2026-10-15T06:19:54.739Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F7CP4HXQPFQ6ZTNS9JR2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:24.738" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:54.738" grpc.time_ms=0.859 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 248.426160] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1202049gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses, in 0.16 seconds)2050gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses2051gitlab # [ 249.535114] gitaly[912]: time="2026-10-15T06:19:55.876Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F8H28Z8XA7PQF93GK7KC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:25.875" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:55.875" grpc.time_ms=0.975 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 249.563175] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 932053gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses, in 0.14 seconds)2054gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses2055gitlab # [ 250.663792] gitaly[912]: time="2026-10-15T06:19:57.005Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3F9MPB1GWYHY3TY9MVATW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:27.003" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:57.004" grpc.time_ms=0.986 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056gitlab # [ 250.709553] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 992057gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses, in 0.14 seconds)2058gitlab # [ 251.561263] nix-daemon[2795]: accepted connection from pid 3657, user nixbot2059gitlab # [ 251.571647] nix-daemon[2795]: accepted connection from pid 3622, user nixbot2060gitlab # [ 251.701590] gitaly[912]: time="2026-10-15T06:19:58.043Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:28.041" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:58.042" grpc.time_ms=0.845 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses2062gitlab # [ 251.718338] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.059Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4b15f0d6c6cb0c4bafdb4c83","created_at":"2026-10-15T06:19:58.045Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcecbbf1c73d788d9dd1286b87d2deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.057Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4b15f0d6c6cb0c4bafdb4c83: start","job_status":"start","queue_duration_s":0.002302,"scheduling_latency_s":0.002332}2063gitlab # [ 251.746165] gitaly[912]: time="2026-10-15T06:19:58.088Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:20:08.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:58.079" grpc.time_ms=8.521 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2064gitlab # [ 251.772192] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.114Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4b15f0d6c6cb0c4bafdb4c83","created_at":"2026-10-15T06:19:58.045Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcecbbf1c73d788d9dd1286b87d2deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.057Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4b15f0d6c6cb0c4bafdb4c83: done: 0.054395 sec","job_status":"done","queue_duration_s":0.002302,"scheduling_latency_s":0.002332,"redis_calls":9,"redis_duration_s":0.007648,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004965,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001658,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054395,"completed_at":"2026-10-15T06:19:58.114Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2065gitlab # [ 251.803969] gitaly[912]: time="2026-10-15T06:19:58.146Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAR7MVKB0EXVVYCF79AD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:28.144" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:58.145" grpc.time_ms=0.969 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 251.819789] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2082067gitlab # [ 251.828311] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.169Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a382511b0842f40fa620f03c","created_at":"2026-10-15T06:19:58.140Z","trace_propagation_headers":{"sentry-trace":"9542f2d6326a4094a4268d8b868e3f5d-4f40839f24b34776","baggage":"sentry-trace_id=9542f2d6326a4094a4268d8b868e3f5d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3FAM057W3TFA98HHPB5FT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.147Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a382511b0842f40fa620f03c: start","job_status":"start","queue_duration_s":0.022003,"scheduling_latency_s":0.022035}2068gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses, in 0.15 seconds)2069gitlab # [ 251.865039] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 1172070gitlab # [ 251.865444] gitaly[912]: time="2026-10-15T06:19:58.206Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FATPZK9XW77A13WTHC3S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:28.204" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:58.205" grpc.time_ms=0.844 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 251.907894] gitaly[912]: time="2026-10-15T06:19:58.250Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3FATPZK9XW77A13WTHC3S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:20:08.174" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:58.244" grpc.time_ms=5.109 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 251.945366] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1212073gitlab # [ 251.999980] gitaly[912]: time="2026-10-15T06:19:58.342Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAYWVJPDD47VYGXA01BR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:28.341" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:58.341" grpc.time_ms=0.395 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 252.027829] gitaly[912]: time="2026-10-15T06:19:58.370Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:58.369" grpc.time_ms=0.532 pid=912 span.kind=server system=grpc2075gitlab # [ 252.029061] gitaly[912]: time="2026-10-15T06:19:58.371Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3FAYWVJPDD47VYGXA01BR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-15T06:20:08.294" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:58.364" grpc.time_ms=7.093 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 252.068346] gitaly[912]: time="2026-10-15T06:19:58.410Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:58.410" grpc.time_ms=0.341 pid=912 span.kind=server system=grpc2077gitlab # [ 252.092980] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b6a58e71d3a2c27b910b4e1e57499f553f6202f1 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1342078gitlab # [ 252.097278] gitaly[912]: time="2026-10-15T06:19:58.439Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-15T06:19:58.439" grpc.time_ms=0.392 pid=912 span.kind=server system=grpc2079gitlab # [ 252.108445] gitaly[912]: time="2026-10-15T06:19:58.450Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:28.238" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:58.339" operations="[repack_refs]" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab # [ 252.119444] gitaly[912]: time="2026-10-15T06:19:58.461Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:28.238" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:58.339" pid=912 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-15 06:18:55.088209095 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2081gitlab # [ 252.134066] gitaly[912]: time="2026-10-15T06:19:58.476Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT diskcache=66192c24-8ebb-4b54-b56e-cca1bcfcefef grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:28.238" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:58.339" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 252.134416] gitaly[912]: time="2026-10-15T06:19:58.476Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=66 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7299 command.oublock=0 command.real_time_ms=111 command.spawn_token_fork_ms=0 command.system_time_ms=39 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:28.238" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:58.339" grpc.time_ms=137.467 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 252.165548] gitaly[912]: time="2026-10-15T06:19:58.508Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:28.238" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:58.339" pid=912 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2084gitlab # [ 252.165741] gitaly[912]: time="2026-10-15T06:19:58.508Z" level=info msg="optimized repository" clean_stale_data_time=34.862531ms clean_work_trees_time="80.736µs" commit_graph_time="3.911µs" correlation_id=01M4Z3FAM057W3TFA98HHPB5FT gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.47µs" pid=912 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.632µs" storage_name=default system=housekeeping total_time=35.054735ms2085gitlab # [ 252.166423] gitaly[912]: time="2026-10-15T06:19:58.508Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-15T06:20:28.238" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-15T06:19:58.339" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 252.176175] gitaly[912]: time="2026-10-15T06:19:58.518Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-15T06:20:28.417" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:58.518" grpc.time_ms=0.622 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 252.194731] gitaly[912]: time="2026-10-15T06:19:58.537Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FAM057W3TFA98HHPB5FT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-15T06:20:28.436" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-15T06:19:58.536" grpc.time_ms=0.401 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 252.205150] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.547Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"88d9d198b705a6259f9eb319","created_at":"2026-10-15T06:19:58.545Z","trace_propagation_headers":{"sentry-trace":"9542f2d6326a4094a4268d8b868e3f5d-7ded9b411ffa46bd","baggage":"sentry-trace_id=9542f2d6326a4094a4268d8b868e3f5d,sentry-release=Unknown"},"correlation_id":"01M4Z3FAM057W3TFA98HHPB5FT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"a382511b0842f40fa620f03c","job_size_bytes":3,"pid":2506,"job_status":"deduplicated","message":"PipelineProcessWorker JID-88d9d198b705a6259f9eb319: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2089gitlab # [ 252.206342] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.548Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a382511b0842f40fa620f03c","created_at":"2026-10-15T06:19:58.140Z","trace_propagation_headers":{"sentry-trace":"9542f2d6326a4094a4268d8b868e3f5d-4f40839f24b34776","baggage":"sentry-trace_id=9542f2d6326a4094a4268d8b868e3f5d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3FAM057W3TFA98HHPB5FT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.147Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2506,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a382511b0842f40fa620f03c: rescheduled"}2090gitlab # [ 252.211593] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.553Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a382511b0842f40fa620f03c","created_at":"2026-10-15T06:19:58.140Z","trace_propagation_headers":{"sentry-trace":"9542f2d6326a4094a4268d8b868e3f5d-4f40839f24b34776","baggage":"sentry-trace_id=9542f2d6326a4094a4268d8b868e3f5d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4Z3FAM057W3TFA98HHPB5FT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.147Z","job_size_bytes":3,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a382511b0842f40fa620f03c: done: 0.384131 sec","job_status":"done","queue_duration_s":0.022003,"scheduling_latency_s":0.022035,"gitaly_calls":3,"gitaly_duration_s":0.144195,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.022691,"redis_read_bytes":247,"redis_write_bytes":21781,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002711,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001327,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.004116,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.006425,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001082,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000386,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003933,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.038,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105393,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.271669723,"duration_s":0.384131,"completed_at":"2026-10-15T06:19:58.553Z","load_balancing_strategy":"primary","db_duration_s":0.087278,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091gitlab # [ 252.258350] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5c26312cea5d5e976156de5a","created_at":"2026-10-15T06:19:58.069Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df57e26459b5a21b9a95c0f1356f2da8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.168Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5c26312cea5d5e976156de5a: start","job_status":"start","queue_duration_s":0.386474,"scheduling_latency_s":0.386492}2092gitlab # [ 252.259691] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5c26312cea5d5e976156de5a","created_at":"2026-10-15T06:19:58.069Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df57e26459b5a21b9a95c0f1356f2da8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.168Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5c26312cea5d5e976156de5a: done: 0.020193 sec","job_status":"done","queue_duration_s":0.386474,"scheduling_latency_s":0.386492,"redis_calls":12,"redis_duration_s":0.001715,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005737322,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.020193,"completed_at":"2026-10-15T06:19:58.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001796,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2093gitlab # [ 252.315220] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"4ea690cfdab260e9e6edf955","created_at":"2026-10-15T06:19:58.197Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb7b148a6f38243a71750ebd5cd1c96d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.202Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-4ea690cfdab260e9e6edf955: start","job_status":"start","queue_duration_s":0.373168,"scheduling_latency_s":0.373182}2094gitlab # [ 252.315846] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"4ea690cfdab260e9e6edf955","created_at":"2026-10-15T06:19:58.197Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb7b148a6f38243a71750ebd5cd1c96d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.202Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-4ea690cfdab260e9e6edf955: done: 0.01686 sec","job_status":"done","queue_duration_s":0.373168,"scheduling_latency_s":0.373182,"redis_calls":11,"redis_duration_s":0.001568,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000314286,"exclusive_lock_hold_duration_s":0.004942249,"duration_s":0.01686,"completed_at":"2026-10-15T06:19:58.592Z","load_balancing_strategy":"primary","db_duration_s":0.002607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2095gitlab # [ 252.368076] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b5f8d59496e6002eaf9bfd12","created_at":"2026-10-15T06:19:58.208Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b923291c4e8ce5ac200580bcd9bb389b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.221Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b5f8d59496e6002eaf9bfd12: start","job_status":"start","queue_duration_s":0.372026,"scheduling_latency_s":0.37204}2096gitlab # [ 252.368825] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.601Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2097gitlab # [ 252.369507] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b5f8d59496e6002eaf9bfd12","created_at":"2026-10-15T06:19:58.208Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b923291c4e8ce5ac200580bcd9bb389b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.221Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b5f8d59496e6002eaf9bfd12: done: 0.0116 sec","job_status":"done","queue_duration_s":0.372026,"scheduling_latency_s":0.37204,"redis_calls":9,"redis_duration_s":0.001274,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0116,"completed_at":"2026-10-15T06:19:58.605Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 252.413689] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8181b28f606b8fe528e27430","created_at":"2026-10-15T06:19:58.228Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6216acca26d66cdc11bf339b9a7d9bc5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.234Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8181b28f606b8fe528e27430: start","job_status":"start","queue_duration_s":0.371558,"scheduling_latency_s":0.371572}2099gitlab # [ 252.416186] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8181b28f606b8fe528e27430","created_at":"2026-10-15T06:19:58.228Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6216acca26d66cdc11bf339b9a7d9bc5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.234Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8181b28f606b8fe528e27430: done: 0.03883 sec","job_status":"done","queue_duration_s":0.371558,"scheduling_latency_s":0.371572,"redis_calls":13,"redis_duration_s":0.002379,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000664,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000837,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000785296,"exclusive_lock_hold_duration_s":0.021331203,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.03883,"completed_at":"2026-10-15T06:19:58.645Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2100gitlab # [ 252.460574] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.646Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f629f4581c87d8b5ca10bdcf","created_at":"2026-10-15T06:19:58.246Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b79c68f71e2f1ae05c8a4cce998bb8a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-15T06:19:58.263Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f629f4581c87d8b5ca10bdcf: start","job_status":"start","queue_duration_s":0.383139,"scheduling_latency_s":0.383161}2101gitlab # [ 252.505789] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.654Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2102gitlab # [ 252.506631] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.658Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f629f4581c87d8b5ca10bdcf","created_at":"2026-10-15T06:19:58.246Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b79c68f71e2f1ae05c8a4cce998bb8a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-15T06:19:58.263Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f629f4581c87d8b5ca10bdcf: done: 0.012375 sec","job_status":"done","queue_duration_s":0.383139,"scheduling_latency_s":0.383161,"redis_calls":9,"redis_duration_s":0.0011970000000000001,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012375,"completed_at":"2026-10-15T06:19:58.658Z","load_balancing_strategy":"primary","db_duration_s":0.000368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2103gitlab # [ 252.508526] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"57b9f55c81aaae76a2865f9b","created_at":"2026-10-15T06:19:58.275Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5ac24270fa4d39c1a605b6bd2007613","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-15T06:19:58.285Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-57b9f55c81aaae76a2865f9b: start","job_status":"start","queue_duration_s":0.374948,"scheduling_latency_s":0.374964}2104gitlab # [ 252.551967] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"57b9f55c81aaae76a2865f9b","created_at":"2026-10-15T06:19:58.275Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5ac24270fa4d39c1a605b6bd2007613","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-15T06:19:58.285Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-57b9f55c81aaae76a2865f9b: done: 0.076236 sec","job_status":"done","queue_duration_s":0.374948,"scheduling_latency_s":0.374964,"redis_calls":9,"redis_duration_s":0.001529,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076236,"completed_at":"2026-10-15T06:19:58.736Z","load_balancing_strategy":"primary","db_duration_s":0.002638,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2105gitlab # [ 252.595861] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"16f8e12237226880bb150a12","created_at":"2026-10-15T06:19:58.298Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13429ce398229ae552ace6911f54c3c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.311Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-16f8e12237226880bb150a12: start","job_status":"start","queue_duration_s":0.425817,"scheduling_latency_s":0.425836}2106gitlab # [ 252.597028] nixbot[2629]: {"ts": "2026-10-15T06:19:58.860Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 2, "sha": "b6a58e71d3a2c27b910b4e1e57499f553f6202f1", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}2107gitlab # [ 252.597642] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 392108gitlab # [ 252.598105] gitaly[912]: time="2026-10-15T06:19:58.931Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3FBHB4EGDEQ057H99P0V2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:58.924" grpc.time_ms=6.152 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2109gitlab # [ 252.598755] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"16f8e12237226880bb150a12","created_at":"2026-10-15T06:19:58.298Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13429ce398229ae552ace6911f54c3c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.311Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-16f8e12237226880bb150a12: done: 0.013199 sec","job_status":"done","queue_duration_s":0.425817,"scheduling_latency_s":0.425836,"redis_calls":11,"redis_duration_s":0.001502,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013199,"completed_at":"2026-10-15T06:19:58.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2110gitlab # [ 252.639113] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"224a51b53691a6b0b2efb17b","created_at":"2026-10-15T06:19:58.320Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"676e88f506cf8df2ad8d7d296a25348f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.328Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-224a51b53691a6b0b2efb17b: start","job_status":"start","queue_duration_s":0.423304,"scheduling_latency_s":0.423318}2111gitlab # [ 252.639940] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.771Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"224a51b53691a6b0b2efb17b","created_at":"2026-10-15T06:19:58.320Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"676e88f506cf8df2ad8d7d296a25348f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.328Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-224a51b53691a6b0b2efb17b: done: 0.019619 sec","job_status":"done","queue_duration_s":0.423304,"scheduling_latency_s":0.423318,"redis_calls":9,"redis_duration_s":0.001422,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019619,"completed_at":"2026-10-15T06:19:58.771Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004137,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2112gitlab # [ 252.696727] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.772Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c6a85e8f64830c6baf180d22","created_at":"2026-10-15T06:19:58.329Z","trace_propagation_headers":{"sentry-trace":"9542f2d6326a4094a4268d8b868e3f5d-7ded9b411ffa46bd","baggage":"sentry-trace_id=9542f2d6326a4094a4268d8b868e3f5d,sentry-release=Unknown"},"correlation_id":"01M4Z3FAM057W3TFA98HHPB5FT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.331Z","job_size_bytes":23,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c6a85e8f64830c6baf180d22: start","job_status":"start","queue_duration_s":0.440362,"scheduling_latency_s":0.44039}2113gitlab # [ 252.697641] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.800Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c6a85e8f64830c6baf180d22","created_at":"2026-10-15T06:19:58.329Z","trace_propagation_headers":{"sentry-trace":"9542f2d6326a4094a4268d8b868e3f5d-7ded9b411ffa46bd","baggage":"sentry-trace_id=9542f2d6326a4094a4268d8b868e3f5d,sentry-release=Unknown"},"correlation_id":"01M4Z3FAM057W3TFA98HHPB5FT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.331Z","job_size_bytes":23,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c6a85e8f64830c6baf180d22: done: 0.028707 sec","job_status":"done","queue_duration_s":0.440362,"scheduling_latency_s":0.44039,"redis_calls":7,"redis_duration_s":0.00107,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028707,"completed_at":"2026-10-15T06:19:58.800Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006197,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2114gitlab # [ 252.747184] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.801Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e7dde74683a13a16da514647","created_at":"2026-10-15T06:19:58.339Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79f94426c90eca217e72c5c7a47201e9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.345Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e7dde74683a13a16da514647: start","job_status":"start","queue_duration_s":0.456788,"scheduling_latency_s":0.456805}2115gitlab # [ 252.747861] gitlab-workhorse[824]: time="2026-10-15T06:19:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672116gitlab # [ 252.748425] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 512117gitlab # [ 252.748899] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 462118gitlab # [ 252.749802] gitaly[912]: time="2026-10-15T06:19:58.982Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FBJM6K2GPXV016XZ15V4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:58.974" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2119gitlab # [ 252.751035] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e7dde74683a13a16da514647","created_at":"2026-10-15T06:19:58.339Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79f94426c90eca217e72c5c7a47201e9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.345Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e7dde74683a13a16da514647: done: 0.023224 sec","job_status":"done","queue_duration_s":0.456788,"scheduling_latency_s":0.456805,"redis_calls":11,"redis_duration_s":0.001862,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000687,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000393905,"exclusive_lock_hold_duration_s":0.002647264,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.023224,"completed_at":"2026-10-15T06:19:58.824Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2120gitlab # [ 252.808083] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8a680fac99cdb1fbd225701a","created_at":"2026-10-15T06:19:58.351Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5124bc474885b8bb3b9d452275361c56","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-15T06:19:58.354Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8a680fac99cdb1fbd225701a: start","job_status":"start","queue_duration_s":0.471232,"scheduling_latency_s":0.471246}2121gitlab # [ 252.808664] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.833Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2122gitlab # [ 252.809170] gitaly[912]: time="2026-10-15T06:19:58.982Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FBJM6K2GPXV016XZ15V4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:58.974" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2123gitlab # [ 252.851217] gitlab-workhorse[824]: time="2026-10-15T06:19:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672124gitlab # [ 252.851789] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/15:06:19:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 532125gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses2126gitlab # [ 252.852482] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8a680fac99cdb1fbd225701a","created_at":"2026-10-15T06:19:58.351Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5124bc474885b8bb3b9d452275361c56","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-15T06:19:58.354Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8a680fac99cdb1fbd225701a: done: 0.011941 sec","job_status":"done","queue_duration_s":0.471232,"scheduling_latency_s":0.471246,"redis_calls":9,"redis_duration_s":0.001578,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011941,"completed_at":"2026-10-15T06:19:58.837Z","load_balancing_strategy":"primary","db_duration_s":0.00037,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2127gitlab # [ 252.854070] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a8adb990e3580071abbb5c99","created_at":"2026-10-15T06:19:58.358Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c9378e0bd8a6ec26b2fb42dd16eeb33","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.361Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a8adb990e3580071abbb5c99: start","job_status":"start","queue_duration_s":0.477445,"scheduling_latency_s":0.477458}2128gitlab # [ 252.866940] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.845Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2129gitlab # [ 252.869691] gitaly[912]: time="2026-10-15T06:19:58.983Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4Z3FBJM6K2GPXV016XZ15V4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-15T06:19:58.974" grpc.time_ms=8.479 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2130gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6a58e71d3a2c27b910b4e1e57499f553f6202f1/statuses, in 0.09 seconds)2131(finished: subtest: eval and build post commit statuses, in 5.79 seconds)2132(finished: run the VM test script, in 299.99 seconds)2133gitlab # [ 252.882835] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a8adb990e3580071abbb5c99","created_at":"2026-10-15T06:19:58.358Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c9378e0bd8a6ec26b2fb42dd16eeb33","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.361Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a8adb990e3580071abbb5c99: done: 0.010984 sec","job_status":"done","queue_duration_s":0.477445,"scheduling_latency_s":0.477458,"redis_calls":9,"redis_duration_s":0.0011819999999999999,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010984,"completed_at":"2026-10-15T06:19:58.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2134gitlab # [ 252.930669] sidekiq-cluster[2506]: {"severity":"INFO","time":"2026-10-15T06:19:58.850Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"079bf954fafc4f43d5f010de","created_at":"2026-10-15T06:19:58.365Z","trace_propagation_headers":{"sentry-trace":"323f25e7ca5d4ef79efa58ee5129c0e4-b3420d18d67544b7","baggage":"sentry-trace_id=323f25e7ca5d4ef79efa58ee5129c0e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2b7cf14dce218b89b0d472bb343cb12","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-15T06:19:58.368Z","job_size_bytes":2,"pid":2506,"sidekiq_tid":"m7xa","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-079bf954fafc4f43d5f010de: start","job_status":"start","queue_duration_s":0.482164,"scheduling_latency_s":0.482178}2135test script finished in 300.02s2136cleanup2137kill QemuMachine (pid 46)2138gitlab # [ 252.931694] gitaly[912]: time="2026-10-15T06:19:59.059Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=11 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4Z3FBN4ZNG2XJKPC6C3SB0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glReposiqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2139gitlab # t2140(finished: cleanup, in 1.24 seconds)2141additionally exposed symbols:2142 gitlab,2143 vlan1,2144 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2145[]2146[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-15T06:19:05.289Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2147[]2148[]2149[]2150[]2151[]2152[]2153[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'b6a58e71d3a2c27b910b4e1e57499f553f6202f1', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-15T06:19:52.352091Z', 'started_at': '2026-10-15T06:19:52.720324Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2154[{'id': 5, 'sha': 'b6a58e71d3a2c27b910b4e1e57499f553f6202f1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-15T06:19:52.688Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2155[{'id': 5, 'sha': 'b6a58e71d3a2c27b910b4e1e57499f553f6202f1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-15T06:19:52.688Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2156[{'id': 5, 'sha': 'b6a58e71d3a2c27b910b4e1e57499f553f6202f1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-15T06:19:52.688Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2157[{'id': 5, 'sha': 'b6a58e71d3a2c27b910b4e1e57499f553f6202f1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-15T06:19:52.688Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2158[{'id': 5, 'sha': 'b6a58e71d3a2c27b910b4e1e57499f553f6202f1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-10-15T06:19:52.688Z', 'started_at': None, 'finished_at': '2026-10-15T06:19:58.126Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2159[{'id': 5, 'sha': 'b6a58e71d3a2c27b910b4e1e57499f553f6202f1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-10-15T06:19:52.688Z', 'started_at': None, 'finished_at': '2026-10-15T06:19:58.126Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'b6a58e71d3a2c27b910b4e1e57499f553f6202f1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-15T06:19:58.270Z', 'started_at': None, 'finished_at': '2026-10-15T06:19:58.408Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]