vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #410
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.Ul0WfdhDin', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: a528a083-3bdb-4924-8768-0798968f61bb16gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20(finished: start all VMs, in 48.96 seconds)21gitlab # Writing inode tables: 0/8 done22gitlab: waiting for unit setup-gitlab.service23gitlab # Creating journal (8192 blocks): done24gitlab: waiting for the VM to finish booting25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0cr7dsgzdc4p5m8y2nynpfjs52r7rivx-nixos-system-gitlab-test/init regInfo=/nix/store/1jfdnymgmzs2af1affw5snpj9v9nlxx2-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 514545679 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000878] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002731] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002742] Using GB pages for direct mapping73gitlab # [ 0.002816] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002824] ACPI: Early table checksum verification disabled75gitlab # [ 0.002827] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002831] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002834] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002841] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002843] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002845] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002846] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002848] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002849] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002850] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002851] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002851] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002852] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002852] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003085] No NUMA configuration found90gitlab # [ 0.003086] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003088] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005409] Zone ranges:93gitlab # [ 0.005410] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005411] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005412] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005413] Device empty97gitlab # [ 0.005414] Movable zone start for each node98gitlab # [ 0.005415] Early memory node ranges99gitlab # [ 0.005415] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005416] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005417] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005418] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005438] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005715] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.115623] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.116059] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.116075] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.116106] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.116108] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.116110] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.116111] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.116112] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.116113] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.116116] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.116117] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.116122] TSC deadline timer available117gitlab # [ 0.116127] CPU topo: Max. logical packages: 1118gitlab # [ 0.116127] CPU topo: Max. logical dies: 1119gitlab # [ 0.116128] CPU topo: Max. dies per package: 1120gitlab # [ 0.116131] CPU topo: Max. threads per core: 1121gitlab # [ 0.116132] CPU topo: Num. cores per package: 4122gitlab # [ 0.116132] CPU topo: Num. threads per package: 4123gitlab # [ 0.116133] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.116157] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.116174] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.116176] kvm-guest: setup PV sched yield127gitlab # [ 0.116192] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.116193] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.116194] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.116196] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.116197] Booting paravirtualized kernel on KVM132gitlab # [ 0.116201] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.120703] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.122965] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.123013] kvm-guest: PV spinlocks enabled136gitlab # [ 0.123015] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.123018] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0cr7dsgzdc4p5m8y2nynpfjs52r7rivx-nixos-system-gitlab-test/init regInfo=/nix/store/1jfdnymgmzs2af1affw5snpj9v9nlxx2-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.123112] Unknown kernel command line parameters "regInfo=/nix/store/1jfdnymgmzs2af1affw5snpj9v9nlxx2-closure-info/registration", will be passed to user space.139gitlab # [ 0.123126] random: crng init done140gitlab # [ 0.123127] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.131696] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.135827] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.135906] software IO TLB: area num 4.144gitlab # [ 0.206318] Fallback order for Node 0: 0145gitlab # [ 0.206325] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.206327] Policy zone: Normal147gitlab # [ 0.208746] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.218391] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.231399] allocated 12582912 bytes of page_ext150gitlab # [ 0.241559] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.241561] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.242427] Dynamic Preempt: lazy153gitlab # [ 0.242622] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.242623] rcu: RCU event tracing is enabled.155gitlab # [ 0.242624] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.242625] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.242626] Rude variant of Tasks RCU enabled.158gitlab # [ 0.242626] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.242627] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.242627] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.242648] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.242649] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.242650] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.247007] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.247292] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.247300] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.247403] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.251024] Console: colour VGA+ 80x25169gitlab # [ 0.251027] printk: legacy console [tty0] enabled170gitlab # [ 0.281821] printk: legacy console [ttyS0] enabled171gitlab # [ 0.390278] ACPI: Core revision 20250807172gitlab # [ 0.391235] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.392841] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.393896] x2apic enabled175gitlab # [ 0.394657] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.395613] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.396886] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.398431] kvm-guest: setup PV IPIs179gitlab # [ 0.400030] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.401100] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.402911] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.403996] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.405036] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.406909] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.407912] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.408909] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.409909] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.411709] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.412677] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.413730] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.414916] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.415909] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.416910] active return thunk: srso_alias_return_thunk194gitlab # [ 0.418615] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.419909] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.420908] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.421908] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.422909] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.423908] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.424907] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.425909] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.426909] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.427907] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.428909] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.429908] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.430908] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.460331] Freeing SMP alternatives memory: 44K208gitlab # [ 0.460912] pid_max: default: 32768 minimum: 301209gitlab # [ 0.462010] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.463019] landlock: Up and running.211gitlab # [ 0.463909] Yama: becoming mindful.212gitlab # [ 0.464760] LSM support for eBPF active213gitlab # [ 0.465617] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.467050] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.469787] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.470473] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.470914] ... version: 2218gitlab # [ 0.471700] ... bit width: 48219gitlab # [ 0.471911] ... generic counters: 6220gitlab # [ 0.472694] ... generic bitmap: 000000000000003f221gitlab # [ 0.472922] ... fixed-purpose counters: 0222gitlab # [ 0.473704] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.474670] ... value mask: 0000ffffffffffff224gitlab # [ 0.474911] ... max period: 00007fffffffffff225gitlab # [ 0.475872] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.476791] signal: max sigframe size: 3376227gitlab # [ 0.477574] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.477915] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.479035] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.484574] smp: Bringing up secondary CPUs ...231gitlab # [ 0.485331] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.485914] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.489010] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.490672] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.491412] Memory: 6011328K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.492911] devtmpfs: initialized237gitlab # [ 0.493730] x86/mm: Memory block size: 128MB238gitlab # [ 0.496966] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.497983] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.499005] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.500165] PM: RTC time: 06:56:44, date: 2026-10-03242gitlab # [ 0.503698] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.506254] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.506965] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.508964] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.509922] audit: initializing netlink subsys (disabled)247gitlab # [ 0.510963] audit: type=2000 audit(1791010604.251:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.511228] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.512913] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.513911] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.514911] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.515911] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.516926] cpuidle: using governor menu254gitlab # [ 0.519114] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.520170] PCI: Using configuration type 1 for base access256gitlab # [ 0.520912] PCI: Using configuration type 1 for extended access257gitlab # [ 0.522078] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.525021] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.525912] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.526911] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.527911] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.533012] ACPI: Added _OSI(Module Device)263gitlab # [ 0.534920] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.536920] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.543870] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.550147] ACPI: Interpreter enabled267gitlab # [ 0.550928] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.551668] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.551930] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.552912] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.554370] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.567160] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.569929] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.574086] acpiphp: Slot [3] registered275gitlab # [ 0.576044] acpiphp: Slot [4] registered276gitlab # [ 0.578026] acpiphp: Slot [5] registered277gitlab # [ 0.580065] acpiphp: Slot [6] registered278gitlab # [ 0.582015] acpiphp: Slot [7] registered279gitlab # [ 0.584069] acpiphp: Slot [8] registered280gitlab # [ 0.586003] acpiphp: Slot [9] registered281gitlab # [ 0.587000] acpiphp: Slot [10] registered282gitlab # [ 0.589008] acpiphp: Slot [11] registered283gitlab # [ 0.591021] acpiphp: Slot [12] registered284gitlab # [ 0.591986] acpiphp: Slot [13] registered285gitlab # [ 0.593953] acpiphp: Slot [14] registered286gitlab # [ 0.594971] acpiphp: Slot [15] registered287gitlab # [ 0.596956] acpiphp: Slot [16] registered288gitlab # [ 0.597953] acpiphp: Slot [17] registered289gitlab # [ 0.599954] acpiphp: Slot [18] registered290gitlab # [ 0.600970] acpiphp: Slot [19] registered291gitlab # [ 0.602955] acpiphp: Slot [20] registered292gitlab # [ 0.603954] acpiphp: Slot [21] registered293gitlab # [ 0.604954] acpiphp: Slot [22] registered294gitlab # [ 0.606970] acpiphp: Slot [23] registered295gitlab # [ 0.607931] acpiphp: Slot [24] registered296gitlab # [ 0.608655] acpiphp: Slot [25] registered297gitlab # [ 0.608930] acpiphp: Slot [26] registered298gitlab # [ 0.609675] acpiphp: Slot [27] registered299gitlab # [ 0.610932] acpiphp: Slot [28] registered300gitlab # [ 0.611626] acpiphp: Slot [29] registered301gitlab # [ 0.611939] acpiphp: Slot [30] registered302gitlab # [ 0.612675] acpiphp: Slot [31] registered303gitlab # [ 0.613940] PCI host bridge to bus 0000:00304gitlab # [ 0.614630] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.614911] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.615914] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.617913] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.618938] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.620930] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.622306] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.626450] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.632137] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.639991] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.643004] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.645923] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.648923] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.651922] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.655412] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.660972] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.665085] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.669501] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.671935] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.675398] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.691098] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.693953] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.696974] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.700162] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.705989] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.716936] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.718932] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.720972] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.751932] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.757100] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.763951] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.764847] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.765682] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.768402] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.773948] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.774840] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.775685] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.778120] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.783549] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.784559] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.786960] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.791414] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.801965] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.802920] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.803922] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.806260] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.810945] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.811835] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.813690] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.816074] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.819948] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.821924] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.822915] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.823946] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.826159] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.829942] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.830941] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.836281] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.844957] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.846940] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.849995] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.857082] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.865946] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.869942] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.872005] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.883613] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.886272] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.888224] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.891218] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.893091] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.897045] iommu: Default domain type: Translated375gitlab # [ 0.897754] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.899206] ACPI: bus type USB registered377gitlab # [ 0.899963] usbcore: registered new interface driver usbfs378gitlab # [ 0.900893] usbcore: registered new interface driver hub379gitlab # [ 0.901619] usbcore: registered new device driver usb380gitlab # [ 0.904128] NetLabel: Initializing381gitlab # [ 0.904738] NetLabel: domain hash size = 128382gitlab # [ 0.905443] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.905943] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.906876] PCI: Using ACPI for IRQ routing385gitlab # [ 0.908009] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.908907] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.908907] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.910913] vgaarb: loaded389gitlab # [ 0.911626] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.912911] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.917990] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.919528] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.920267] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.921639] pnp: PnP ACPI init395gitlab # [ 0.922762] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.930911] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.932443] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.933452] NET: Registered PF_INET protocol family399gitlab # [ 0.935485] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.952560] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.954076] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.956056] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.959672] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.961015] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.962158] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.963753] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.965163] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.966517] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.967496] NET: Registered PF_XDP protocol family410gitlab # [ 0.968367] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.969400] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.970433] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.971567] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.972708] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.974056] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.975020] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.977329] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.979938] PCI: CLS 0 bytes, default 64419gitlab # [ 0.980769] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.981139] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.981968] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.982087] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 1.005333] Initialise system trusted keyrings424gitlab # [ 1.006522] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.017950] Key type asymmetric registered426gitlab # [ 1.018760] Asymmetric key parser 'x509' registered427gitlab # [ 1.019680] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.021322] io scheduler mq-deadline registered429gitlab # [ 1.022100] io scheduler kyber registered430gitlab # [ 1.026163] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.027552] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.029888] Linux agpgart interface v0.103433gitlab # [ 1.030692] ACPI: bus type drm_connector registered434gitlab # [ 1.033308] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.034398] usbserial: USB Serial support registered for generic436gitlab # [ 1.035410] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.035410] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.037680] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.039065] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.040242] NET: Registered PF_INET6 protocol family441gitlab # [ 1.041967] Segment Routing with IPv6442gitlab # [ 1.042659] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.045163] IPI shorthand broadcast: enabled444gitlab # [ 1.049433] sched_clock: Marking stable (901011513, 147607901)->(1076328278, -27708864)445gitlab # [ 1.051198] registered taskstats version 1446gitlab # [ 1.052196] Loading compiled-in X.509 certificates447gitlab # [ 1.061873] Demotion targets for Node 0: null448gitlab # [ 1.062937] Key type .fscrypt registered449gitlab # [ 1.063650] Key type fscrypt-provisioning registered450gitlab # [ 1.064653] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.065571] ima: Allocated hash algorithm: sha1452gitlab # [ 1.066589] ima: No architecture policies found453gitlab # [ 1.067693] PM: Magic number: 14:773:922454gitlab # [ 1.069291] RAS: Correctable Errors collector initialized.455gitlab # [ 1.073775] clk: Disabling unused clocks456gitlab # [ 1.074496] PM: genpd: Disabling unused power domains457gitlab # [ 1.264971] Freeing initrd memory: 29392K458gitlab # [ 1.268417] Freeing unused decrypted memory: 2028K459gitlab # [ 1.271133] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.272201] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.274268] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.275907] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.339570] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.340739] Run /init as init process465gitlab # [ 1.351964] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.373079] fuse: init (API version 7.45)467gitlab # [ 1.381121] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.388260] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.391554] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.432117] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.768497] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.809684] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.811861] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.814024] systemd[1]: Running in initrd.475gitlab # [ 1.816439] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.819405] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.931821] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.973345] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.981122] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.982259] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.983675] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.984833] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.985941] systemd[1]: Reached target Path Units.484gitlab # [ 1.986809] systemd[1]: Reached target Slice Units.485gitlab # [ 1.987707] systemd[1]: Reached target Swaps.486gitlab # [ 1.988508] systemd[1]: Reached target Timer Units.487gitlab # [ 1.989490] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.990726] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.991875] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.992886] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.993904] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.994860] systemd[1]: Reached target Socket Units.493gitlab # [ 1.996825] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.998843] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.000884] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.012523] systemd[1]: Starting Journal Service...497gitlab # [ 2.018542] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.019523] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.024492] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.029587] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.033821] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.037954] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.041366] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config504gitlab # [ 2.049709] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...505gitlab # [ 2.051864] systemd-journald[92]: Collecting audit messages is disabled.506gitlab # [ 2.073688] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.078494] netfs: FS-Cache loaded508gitlab # [ 2.078675] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev509gitlab # [ 2.081914] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.510gitlab # [ 2.084457] systemd[1]: Starting Create Static Device Nodes in /dev...511gitlab # [ 2.087373] 9pnet: Installing 9P2000 support512gitlab # [ 2.094104] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 2.095458] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.514gitlab # [ 2.097157] systemd[1]: Finished Load Kernel Module 9pnet_virtio.515gitlab # [ 2.099259] systemd[1]: Starting Apply Kernel Variables...516gitlab # [ 2.103749] systemd[1]: Finished Create Static Device Nodes in /dev.517gitlab # [ 2.105075] systemd[1]: Reached target Preparation for Local File Systems.518gitlab # [ 2.106311] systemd[1]: Reached target Local File Systems.519gitlab # [ 2.111522] systemd[1]: Starting Rule-based Manager for Device Events and Files...520gitlab # [ 1.965457] systemd-modules-load[93]: Using 4 probe threads521gitlab # [ 1.967166] systemd-modules-load[93]: Inserted module 'virtio_balloon'522gitlab # [ 2.115536] systemd[1]: Started Journal Service.523gitlab # [ 1.969169] systemd-modules-load[93]: Inserted module 'virtio_gpu'524gitlab # [ 1.970529] systemd-modules-load[93]: Inserted module 'dm_mod'525gitlab # [ 1.971755] systemd[1]: Finished Apply Kernel Variables.526gitlab # [ 1.975860] systemd[1]: Starting Create System Files and Directories...527gitlab # [ 1.985240] systemd-udevd[105]: Using default interface naming scheme 'v261'.528gitlab # [ 1.990971] systemd[1]: Finished Create System Files and Directories.529gitlab # [ 1.998326] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.027467] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.028351] systemd[1]: Reached target System Initialization.532gitlab # [ 2.029244] systemd[1]: Reached target Basic System.533gitlab # [ 2.250996] virtio_blk virtio4: 4/0/0 default/read/poll queues534gitlab # [ 2.255888] uhci_hcd 0000:00:01.2: UHCI Host Controller535gitlab # [ 2.259313] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1536gitlab # [ 2.259392] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)537gitlab # [ 2.259699] uhci_hcd 0000:00:01.2: detected 2 ports538gitlab # [ 2.263897] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140539gitlab # [ 2.264932] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18540gitlab # [ 2.266377] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1541gitlab # [ 2.267930] usb usb1: Product: UHCI Host Controller542gitlab # [ 2.268831] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd543gitlab # [ 2.269661] usb usb1: SerialNumber: 0000:00:01.2544gitlab # [ 2.274329] hub 1-0:1.0: USB hub found545gitlab # [ 2.275732] hub 1-0:1.0: 2 ports detected546gitlab # [ 2.282525] SCSI subsystem initialized547gitlab # [ 2.286734] virtio_blk virtio5: 4/0/0 default/read/poll queues548gitlab # [ 2.289774] virtio_blk virtio5: [vdb] 11952632 512-byte logical blocks (6.12 GB/5.70 GiB)549gitlab # [ 2.297808] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12550gitlab # [ 2.299728] serio: i8042 KBD port at 0x60,0x64 irq 1551gitlab # [ 2.300460] serio: i8042 AUX port at 0x60,0x64 irq 12552gitlab # [ 2.194121] systemd[1]: Starting Virtual Console Setup...553gitlab # [ 2.196477] (udev-worker)[120]: Network interface NamePolicy= disabled on kernel command line.554gitlab # [ 2.198312] (udev-worker)[125]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.555gitlab # [ 2.200313] (udev-worker)[125]: Network interface NamePolicy= disabled on kernel command line.556gitlab # [ 2.362502] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0557gitlab # [ 2.216780] systemd-vconsole-setup[145]: Configuration of first virtual console was skipped, ignoring remaining ones.558gitlab # [ 2.367999] scsi host0: ata_piix559gitlab # [ 2.221459] systemd[1]: Found device /dev/disk/by-label/nixos.560gitlab # [ 2.369095] scsi host1: ata_piix561gitlab # [ 2.370583] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0562gitlab # [ 2.371800] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0563gitlab # [ 2.225493] systemd[1]: Finished Virtual Console Setup.564gitlab # [ 2.227741] systemd[1]: Found device /dev/disk/by-label/nix-store.565gitlab # [ 2.228656] systemd[1]: Reached target Initrd Root Device.566gitlab # [ 2.229419] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...567gitlab # [ 2.252155] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.255738] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.515821] usb 1-1: new full-speed USB device number 2 using uhci_hcd570gitlab # [ 2.531944] ata2: found unknown device (class 0)571gitlab # [ 2.534956] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100572gitlab # [ 2.538940] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5573gitlab # [ 2.595053] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.625406] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.682887] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.685995] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.688826] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.690510] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.692118] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.708382] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.716024] usbcore: registered new interface driver usbhid582gitlab # [ 2.716818] usbhid: USB HID core driver583gitlab # [ 2.722082] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.724574] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.883975] systemd[1]: Mounting /sysroot...586gitlab # [ 3.188546] EXT4-fs (vda): mounted filesystem a528a083-3bdb-4924-8768-0798968f61bb r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.047234] systemd[1]: Mounted /sysroot.588gitlab # [ 3.048881] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.050898] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.052729] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.054582] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.060687] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.068335] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.219488] 9p: Installing v9fs 9p2000 file system support595gitlab # [ 3.220940] erofs (device vdb): mounted with root inode @ nid 128.596gitlab # [ 3.077213] systemd[1]: Starting Mountpoints Configured in the Real Root...597gitlab # [ 3.080283] systemd[1]: Mounted /sysroot/nix/.ro-store.598gitlab # [ 3.081940] systemd[1]: Mounted /sysroot/nix/.rw-store.599gitlab # [ 3.083568] systemd[1]: Mounted /sysroot/run.600gitlab # [ 3.085141] systemd[1]: Mounted /sysroot/tmp/shared.601gitlab # [ 3.086676] systemd[1]: Starting rw-sysroot-nix-store.service...602gitlab # [ 3.088156] systemd-sysroot-fstab-check[181]: /sysroot should be mounted in the initrd, will request daemon-reload.603gitlab # [ 3.089981] systemd[1]: Reload requested from client PID 181 ('systemd-sysroot') (unit initrd-parse-etc.service)...604gitlab # [ 3.091657] systemd[1]: Reloading...605gitlab # [ 3.151095] systemd[1]: Reloading finished in 61 ms.606gitlab # [ 3.176680] systemd-sysroot-fstab-check[181]: Requesting initrd-fs.target/start/replace...607gitlab # [ 3.179526] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.181298] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.184337] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.186299] systemd-sysroot-fstab-check[181]: Requesting swap.target/start/replace...611gitlab # [ 3.188640] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.190421] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.192508] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.194484] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.205813] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.207998] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.883844] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.938225] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.940336] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.942606] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.944768] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.973627] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.978378] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.992098] systemd[1]: Finished Find NixOS closure.625gitlab # [ 3.993938] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 3.996327] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.030691] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.032781] systemd[1]: Stopped target Basic System.629gitlab # [ 4.034530] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.036400] systemd[1]: Stopped target Path Units.631gitlab # [ 4.038120] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.040584] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.043114] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.045394] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.047817] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.049896] systemd[1]: Stopped target Swaps.637gitlab # [ 4.051605] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.053658] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.058377] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.060695] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.063326] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.065127] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.068908] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.071139] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.073513] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.075184] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.077152] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.078541] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.080535] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.082507] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.084346] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.085915] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.087253] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.088924] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.090689] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.092057] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.093957] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.095386] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.096133] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.097099] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.097958] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.098937] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.099772] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.100700] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.101672] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.102658] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.103371] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.104165] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.105197] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.106049] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.107161] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.108166] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.109102] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.109945] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.110974] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.111733] systemd[1]: Reached target Switch Root.677gitlab # [ 4.112381] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.238998] initrd-nixos-activation-start[228]: booting system configuration /nix/store/0cr7dsgzdc4p5m8y2nynpfjs52r7rivx-nixos-system-gitlab-test679gitlab # [ 4.285081] initrd-nixos-activation-start[228]: running activation script...680gitlab # [ 4.536856] initrd-nixos-activation-start[251]: setting up /etc...681gitlab # [ 4.630148] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.632853] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.634524] systemd[1]: Starting Switch Root...684gitlab # [ 4.658119] systemd[1]: Switching root.685gitlab # [ 4.872842] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.985987] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.351794] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.360817] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.362690] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.364672] systemd[1]: Detected first boot.691gitlab # [ 5.367289] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.523321] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.623568] systemd[1]: Applying preset policy.694gitlab # [ 5.767551] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.886049] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.887403] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.889522] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.891678] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.894073] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.895518] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.896469] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.897724] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.898881] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.899668] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.900471] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.901355] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.902129] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.902999] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.903910] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.904832] systemd[1]: Reached target Path Units.711gitlab # [ 5.905582] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.906478] systemd[1]: Reached target Slice Units.713gitlab # [ 5.907278] systemd[1]: Reached target Swaps.714gitlab # [ 5.908678] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.910728] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.912178] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.913754] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.914731] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.917111] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.918689] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.920683] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.921968] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.923116] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.924495] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.927376] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.928552] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.929493] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.932576] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.934843] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.936874] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.940675] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.949522] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.950620] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.954642] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.955725] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.969203] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.970933] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.974544] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.975465] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.981077] systemd[1]: Starting Journal Service...741gitlab # [ 5.987221] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.990653] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.998235] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.999302] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.004131] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.009798] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 6.010859] systemd[1]: Mounted Huge Pages File System.748gitlab # [ 6.011821] systemd[1]: Mounted POSIX Message Queue File System.749gitlab # [ 6.012925] systemd[1]: Mounted Kernel Debug File System.750gitlab # [ 6.013978] systemd[1]: Mounted Kernel Trace File System.751gitlab # [ 6.015332] systemd[1]: Finished Create List of Static Device Nodes.752gitlab # [ 6.015666] systemd-journald[321]: Collecting audit messages is enabled.753gitlab # [ 6.016739] systemd[1]: modprobe@configfs.service: Deactivated successfully.754gitlab # [ 6.018810] systemd[1]: Finished Load Kernel Module configfs.755gitlab # [ 6.020072] systemd[1]: Mounted FUSE Control File System.756gitlab # [ 6.023955] loop: module loaded757gitlab # [ 6.024751] systemd[1]: Mounting Kernel Configuration File System...758gitlab # [ 6.026990] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...759gitlab # [ 6.030486] systemd[1]: Finished Load Kernel Modules.760gitlab # [ 6.030616] EXT4-fs (vda): re-mounted a528a083-3bdb-4924-8768-0798968f61bb.761gitlab # [ 5.889792] systemd[1]: Queued start job for default target M[ 6.037680] systemd[1]: Starting Firewall...762gitlab # ulti-User System.763gitlab # [ 5.893421] systemd[1]: Unnecessary job was removed for /dev/[ 6.041322] systemd[1]: Starting Apply Kernel Variables...764gitlab # vdb.765gitlab # [ 5.895307] systemd[1]: systemd-journald.service: Deactivated successfully.766gitlab # [ 6.043403] systemd[1]: Started Journal Service.767gitlab # [ 5.897363] systemd-modules-load[322]: Using 3 probe threads768gitlab # [ 5.899028] systemd-modules-load[322]: Inserted module 'tls'769gitlab # [ 5.900150] systemd-modules-load[322]: Inserted module 'loop'770gitlab # [ 5.901514] systemd-oomd[323]: No swap; memory pressure usage will be degraded771gitlab # [ 5.903291] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.772gitlab # [ 5.904439] systemd[1]: Finished Remount Root and Kernel File Systems.773gitlab # [ 5.905762] systemd[1]: Listening on Disk Image Download Service Socket.774gitlab # [ 5.909299] systemd[1]: Starting Flush Journal to Persistent Storage...775gitlab # [ 5.910460] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore776gitlab # [ 5.913339] systemd[1]: Starting Load/Save OS Random Seed...777gitlab # [ 5.914545] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os778gitlab # [ 5.916267] systemd[1]: Mounted Kernel Configuration File System.779gitlab # [ 6.071124] systemd-journald[321]: Received client request to flush runtime journal.780gitlab # [ 5.961038] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 5.963621] systemd[1]: Starting Create Static Device Nodes in /dev...782gitlab # [ 5.964799] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 5.965822] systemd[1]: Finished Load/Save OS Random Seed.784gitlab # [ 5.966986] systemd[1]: Reached target First Boot Complete.785gitlab # [ 5.969201] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 5.970199] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 5.971191] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 5.972322] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 5.980280] systemd-udevd[359]: Using default interface naming scheme 'v261'.790gitlab # [ 6.011748] systemd[1]: Started Rule-based Manager for Device Events and Files.791gitlab # [ 6.012943] systemd[1]: Finished Coldplug All udev Devices.792gitlab # [ 6.084832] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.100952] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.110086] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.795gitlab # [ 6.141672] (udev-worker)[428]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.161745] (udev-worker)[423]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.797gitlab # [ 6.163939] (udev-worker)[423]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.172426] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 6.173812] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 6.175519] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 6.177751] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 6.179391] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.180673] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.333815] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console805gitlab # [ 6.345893] Console: switching to colour dummy device 80x25806gitlab # [ 6.346744] [drm] Found bochs VGA, ID 0xb0c5.807gitlab # [ 6.347202] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.808gitlab # [ 6.348264] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3809gitlab # [ 6.351335] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic810gitlab # [ 6.352938] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0811gitlab # [ 6.355173] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0812gitlab # [ 6.357666] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD813gitlab # [ 6.369349] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4814gitlab # [ 6.372167] Console: switching to colour frame buffer device 160x50815gitlab # [ 6.374665] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device816gitlab # [ 6.392244] ACPI: button: Power Button [PWRF]817gitlab # [ 6.395530] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6818gitlab # [ 6.413225] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5819gitlab # [ 6.422677] rtc_cmos 00:05: RTC can wake from S4820gitlab # [ 6.424930] Floppy drive(s): fd0 is 2.88M AMI BIOS821gitlab # [ 6.430669] parport_pc 00:03: reported by Plug and Play ACPI822gitlab # [ 6.432141] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]823gitlab # [ 6.285359] systemd[1]: Finished Firewall.824gitlab # [ 6.437891] FDC 0 is a S82078B825gitlab # [ 6.438564] rtc_cmos 00:05: registered as rtc0826gitlab # [ 6.439741] rtc_cmos 00:05: setting system clock to 2026-10-03T06:56:49 UTC (1791010609)827gitlab # [ 6.440973] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs828gitlab # [ 6.455742] systemd-journald[321]: Time jumped backwards, rotating.829gitlab # [ 6.459732] mousedev: PS/2 mouse device common for all mice830gitlab # [ 6.361849] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.383644] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.388130] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.389735] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.567272] kvm_amd: TSC scaling supported835gitlab # [ 6.567920] kvm_amd: Nested Virtualization enabled836gitlab # [ 6.568417] kvm_amd: Nested Paging enabled837gitlab # [ 6.569129] kvm_amd: LBR virtualization supported838gitlab # [ 6.569735] kvm_amd: Virtual VMLOAD VMSAVE supported839gitlab # [ 6.570256] kvm_amd: Virtual GIF supported840gitlab # [ 6.570875] kvm_amd: Virtual NMI enabled841gitlab # [ 6.577326] ppdev: user-space parallel port driver842gitlab # [ 6.431059] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.843gitlab # [ 6.432219] systemd[1]: Stopped Virtual Console Setup.844gitlab # [ 6.435967] systemd[1]: Starting Virtual Console Setup...845gitlab # [ 6.605174] EDAC MC: Ver: 3.0.0846gitlab # [ 6.490074] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones.847gitlab # [ 6.491921] systemd[1]: Finished Virtual Console Setup.848gitlab # [ 6.743833] systemd[1]: Mounting /run/wrappers...849gitlab # [ 6.769186] systemd[1]: Mounted /run/wrappers.850gitlab # [ 6.771252] systemd[1]: Reached target Local File Systems.851gitlab # [ 6.773200] systemd[1]: Listening on Boot Loader Control Service Socket.852gitlab # [ 6.775516] systemd[1]: Starting register-nix-paths.service...853gitlab # [ 6.778105] systemd[1]: Starting Create SUID/SGID Wrappers...854gitlab # [ 6.780558] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.855gitlab # [ 6.783684] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 6.789382] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 6.822229] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.858gitlab # [ 6.825179] systemd[1]: Finished Save Transient machine-id to Disk.859gitlab # [ 6.826465] systemd[1]: Finished Create System Files and Directories.860gitlab # [ 6.832165] systemd[1]: Starting Rebuild Journal Catalog...861gitlab # [ 6.834827] systemd[1]: Starting Record System Boot/Shutdown in UTMP...862gitlab # [ 6.858817] systemd[1]: Finished Record System Boot/Shutdown in UTMP.863gitlab # [ 6.875549] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 6.877676] systemd[1]: Starting Update is Completed...865gitlab # [ 6.892718] systemd[1]: Finished Update is Completed.866gitlab # [ 6.922423] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 6.923594] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 7.199133] systemd[1]: Finished register-nix-paths.service.869gitlab # [ 7.202417] systemd[1]: Reached target System Initialization.870gitlab # [ 7.204979] systemd[1]: Started Discard unused filesystem blocks once a week.871gitlab # [ 7.207512] systemd[1]: Started logrotate.timer.872gitlab # [ 7.209264] systemd[1]: Started Daily Cleanup of Temporary Directories.873gitlab # [ 7.211543] systemd[1]: Reached target Timer Units.874gitlab # [ 7.213343] systemd[1]: Listening on D-Bus System Message Bus Socket.875gitlab # [ 7.215770] systemd[1]: Listening on Nix Daemon Socket.876gitlab # [ 7.228338] systemd[1]: Starting nixbot CI service socket...877gitlab # [ 7.230427] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.878gitlab # [ 7.234922] systemd[1]: Starting D-Bus System Message Bus...879gitlab # [ 7.237459] systemd[1]: Listening on nixbot CI service socket.880gitlab # [ 7.239646] systemd[1]: Reached target Socket Units.881gitlab # [ 7.293155] dbus-broker-launch[576]: Looking up NSS user entry for 'systemd-timesync'...882gitlab # [ 7.296706] dbus-broker-launch[576]: NSS returned no entry for 'systemd-timesync'883gitlab # [ 7.299469] dbus-broker-launch[576]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"884gitlab # [ 7.304615] systemd[1]: Started D-Bus System Message Bus.885gitlab # [ 7.323655] dbus-broker-launch[576]: Ready886gitlab # [ 7.328189] systemd[1]: Reached target Basic System.887gitlab # [ 7.331254] systemd[1]: Started backdoor.service.888gitlab # [ 7.333883] systemd[1]: Starting gitlab-config.service...889gitlab # [ 7.336446] systemd[1]: Starting Import lastlog data into lastlog2 database...890gitlab # [ 7.346676] systemd[1]: Starting Logrotate configuration check...891gitlab # [ 7.354163] systemd[1]: Starting Name Service Cache Daemon (nsncd)...892gitlab # [ 7.358693] systemd[1]: Starting Post-Boot Actions...893gitlab # [ 7.363052] systemd[1]: Started Reset console on configuration changes.894gitlab # [ 7.376804] systemd[1]: Starting resolvconf update...895gitlab # connecting to host...896gitlab # [ 7.383568] systemd[1]: Finished Post-Boot Actions.897gitlab # [ 7.388893] logrotate[581]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.898gitlab # [ 7.389072] logrotate[581]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf899gitlab # [ 7.389716] logrotate[581]: note: 'monthly' overrides previously specified 'weekly'900gitlab # [ 7.392044] logrotate[581]: Reading state from file: /var/lib/logrotate.status901gitlab # [ 7.392661] logrotate[581]: state file /var/lib/logrotate.status does not exist902gitlab # [ 7.393179] logrotate[581]: Allocating hash table for state file, size 64 entries903gitlab # [ 7.393783] logrotate[581]: Handling 4 logs904gitlab # [ 7.394486] logrotate[581]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed905gitlab # [ 7.394959] logrotate[581]: considering log /var/log/btmp906gitlab # [ 7.395688] logrotate[581]: Creating new state907gitlab # [ 7.396197] logrotate[581]: Now: 2026-10-03 06:56908gitlab # [ 7.396797] logrotate[581]: Last rotated at 2026-10-03 06:00909gitlab # [ 7.397419] logrotate[581]: log does not need rotating (log has already been rotated)910gitlab # [ 7.398104] logrotate[581]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed911gitlab # [ 7.398650] logrotate[581]: considering log /var/log/wtmp912gitlab # [ 7.399149] logrotate[581]: Creating new state913gitlab # [ 7.399824] logrotate[581]: Now: 2026-10-03 06:56914gitlab # [ 7.400609] logrotate[581]: Last rotated at 2026-10-03 06:00915gitlab # [ 7.401288] logrotate[581]: log does not need rotating (log has already been rotated)916gitlab # [ 7.401780] logrotate[581]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed917gitlab # [ 7.402438] logrotate[581]: switching euid from 0 to 165 and egid from 0 to 165 (pid 581)918gitlab # [ 7.402936] logrotate[581]: considering log /var/gitlab/state/log/*.log919gitlab # [ 7.403654] logrotate[581]: log /var/gitlab/state/log/*.log does not exist -- skipping920gitlab # [ 7.404155] logrotate[581]: Creating new state921gitlab # [ 7.404624] logrotate[581]: switching euid from 165 to 0 and egid from 165 to 0 (pid 581)922gitlab # [ 7.405156] logrotate[581]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed923gitlab # [ 7.405636] logrotate[581]: switching euid from 0 to 60 and egid from 0 to 60 (pid 581)924gitlab # [ 7.406193] logrotate[581]: considering log /var/log/nginx/*.log925gitlab # [ 7.406680] logrotate[581]: log /var/log/nginx/*.log does not exist -- skipping926gitlab # [ 7.407181] logrotate[581]: Creating new state927gitlab # [ 7.407682] logrotate[581]: not running postrotate script, since no logs were rotated928gitlab # [ 7.408475] logrotate[581]: switching euid from 60 to 0 and egid from 60 to 0 (pid 581)929gitlab # [ 7.421978] nsncd[582]: Oct 03 06:56:50.629 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"930gitlab # [ 7.422617] systemd[1]: Started Name Service Cache Daemon (nsncd).931gitlab # [ 7.423872] systemd[1]: Finished Logrotate configuration check.932gitlab # [ 7.424635] systemd[1]: Finished Import lastlog data into lastlog2 database.933gitlab: Guest shell says: b'Spawning backdoor root shell...\n'934gitlab # [ 7.431429] systemd[1]: Reached target Host and Network Name Lookups.935gitlab # [ 7.431805] systemd[1]: Reached target User and Group Name Lookups.936gitlab: connected to guest root shell937gitlab # [ 7.434589] systemd[1]: Starting User Login Management...938gitlab: (connecting took 8.11 seconds)939gitlab: (finished: waiting for the VM to finish booting, in 8.11 seconds)940gitlab # [ 7.446964] systemd[1]: Stopped target Host and Network Name Lookups.941gitlab # [ 7.448144] systemd[1]: Stopping Host and Network Name Lookups...942gitlab # [ 7.448616] systemd[1]: Stopped target User and Group Name Lookups.943gitlab # [ 7.449197] systemd[1]: Stopping User and Group Name Lookups...944gitlab # [ 7.449761] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...945gitlab # [ 7.452249] systemd[1]: nscd.service: Deactivated successfully.946gitlab # [ 7.452984] systemd[1]: Stopped Name Service Cache Daemon (nsncd).947gitlab # [ 7.453242] systemd[1]: nscd.service: Consumed 20ms CPU time over 99ms wall clock time, 7.3M memory peak, 5.5M read from disk.948gitlab # [ 7.456290] systemd[1]: Starting Name Service Cache Daemon (nsncd)...949gitlab # [ 7.473497] nsncd[665]: Oct 03 06:56:50.680 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"950gitlab # [ 7.473897] systemd[1]: Started Name Service Cache Daemon (nsncd).951gitlab # [ 7.474581] systemd[1]: Reached target Host and Network Name Lookups.952gitlab # [ 7.475504] systemd[1]: Reached target User and Group Name Lookups.953gitlab # [ 7.482975] systemd-logind[637]: New seat seat0.954gitlab # [ 7.486853] systemd-logind[637]: Watching system buttons on /dev/input/event2 (Power Button)955gitlab # [ 7.487572] systemd-logind[637]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)956gitlab # [ 7.488221] systemd-logind[637]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)957gitlab # [ 7.488703] systemd[1]: Started User Login Management.958gitlab # [ 7.490319] systemd[1]: Starting linger-users.service...959gitlab # [ 7.494061] systemd[1]: Finished resolvconf update.960gitlab # [ 7.495194] systemd[1]: Reached target Preparation for Network.961gitlab # [ 7.510246] systemd[1]: Starting DHCP Client...962gitlab # [ 7.514534] systemd[1]: Starting Address configuration of eth1...963gitlab # [ 7.516083] systemd[1]: Starting Extra networking commands....964gitlab # [ 7.517582] systemd[1]: linger-users.service: Deactivated successfully.965gitlab # [ 7.521414] systemd[1]: Finished linger-users.service.966gitlab # [ 7.541503] network-addresses-eth1-start[698]: adding address 192.168.1.1/24... done967gitlab # [ 7.544989] network-addresses-eth1-start[698]: adding address 2001:db8:1::1/64... done968gitlab # [ 7.549941] systemd[1]: Finished Address configuration of eth1.969gitlab # [ 7.582183] systemd[1]: Finished Extra networking commands..970gitlab # [ 7.583321] systemd[1]: Reached target Network.971gitlab # [ 7.584161] systemd[1]: Starting gitlab-workhorse.service...972gitlab # [ 7.585452] dhcpcd[713]: dhcpcd-10.3.2 starting973gitlab # [ 7.586322] dhcpcd[765]: dev: loaded udev974gitlab # [ 7.587242] systemd[1]: Starting Nginx Web Server...975gitlab # [ 7.589481] systemd[1]: Starting PostgreSQL Server...976gitlab # [ 7.741463] 8021q: 802.1Q VLAN Support v1.8977gitlab # [ 7.594974] systemd[1]: Starting Redis Server[ 7.742818] 8021q: adding VLAN 0 to HW filter on device eth1978gitlab # - redis-gitlab...979gitlab # [ 7.597208] systemd[1]: Starting Permit User Sessions...980gitlab # [ 7.613323] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.981gitlab # [ 7.617155] systemd[1]: Finished Permit User Sessions.982gitlab # [ 7.625683] systemd[1]: Started Getty on tty1.983gitlab # [ 7.626073] systemd[1]: Reached target Login Prompts.984gitlab # [ 7.833024] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 7.837420] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 7.838850] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 7.840740] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 7.841943] cfg80211: failed to load regulatory.db989gitlab # [ 7.725369] nginx-pre-start[790]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok990gitlab # [ 7.727442] nginx-pre-start[790]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful991gitlab # [ 7.730506] redis-server[787]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.992gitlab # [ 7.733302] redis-server[787]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo993gitlab # [ 7.734614] systemd[1]: Started Redis Server - redis-gitlab.994gitlab # [ 7.735533] redis-server[787]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=787, just started995gitlab # [ 7.737383] systemd[1]: Start[ 7.884640] 8021q: adding VLAN 0 to HW filter on device eth0996gitlab # ed Nginx Web Server.997gitlab # [ 7.741726] redis-server[787]: Configuration loaded998gitlab # [ 7.743455] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres".999gitlab # [ 7.745723] postgresql-pre-start[793]: This user must also own the server process.1000gitlab # [ 7.747233] redis[787]: monotonic clock: POSIX clock_gettime1001gitlab # [ 7.748967] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8".1002gitlab # [ 7.752152] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8".1003gitlab # [ 7.752529] postgresql-pre-start[793]: The default text search configuration will be set to "english".1004gitlab # [ 7.753187] postgresql-pre-start[793]: Data page checksums are enabled.1005gitlab # [ 7.753393] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1006gitlab # [ 7.753917] postgresql-pre-start[793]: creating subdirectories ... ok1007gitlab # [ 7.754669] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix1008gitlab # [ 7.755520] redis[787]: Running mode=standalone, port=0.1009gitlab # [ 7.756224] redis[787]: Server initialized1010gitlab # [ 7.756718] redis[787]: Ready to accept connections unix1011gitlab # [ 7.757238] redis[787]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1012gitlab # [ 7.757581] dhcpcd[765]: eth0: waiting for carrier1013gitlab # [ 7.758223] dhcpcd[765]: eth0: carrier acquired1014gitlab # [ 7.758718] dhcpcd[765]: DUID 00:01:00:01:32:53:63:b2:52:54:00:12:34:561015gitlab # [ 7.759564] dhcpcd[765]: eth0: IAID 00:12:34:561016gitlab # [ 7.760106] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:34561017gitlab # [ 7.775392] postgresql-pre-start[793]: selecting default "max_connections" ... 1001018gitlab # [ 7.821061] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB1019gitlab # [ 8.042683] systemd[1]: Started gitlab-workhorse.service.1020gitlab # [ 8.178074] postgresql-pre-start[793]: selecting default time zone ... UTC1021gitlab # [ 8.179745] postgresql-pre-start[793]: creating configuration files ... ok1022gitlab # [ 8.262262] gitlab-workhorse[823]: time="2026-10-03T06:56:51Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41023gitlab # [ 8.263084] gitlab-workhorse[823]: time="2026-10-03T06:56:51Z" level=info msg="Using redis/go-redis"1024gitlab # [ 8.263942] gitlab-workhorse[823]: time="2026-10-03T06:56:51Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1025gitlab # [ 8.343223] postgresql-pre-start[793]: running bootstrap script ... ok1026gitlab # [ 8.511281] dhcpcd[765]: eth0: soliciting a DHCP lease1027gitlab # [ 8.663763] NET: Registered PF_PACKET protocol family1028gitlab # [ 8.523800] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.21029gitlab # [ 8.527390] dhcpcd[765]: eth0: probing address 10.0.2.15/241030gitlab # [ 8.786307] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok1031gitlab # [ 9.073512] postgresql-pre-start[793]: syncing data to disk ... ok1032gitlab # [ 9.074329] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections1033gitlab # [ 9.074781] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1034gitlab # [ 9.075454] postgresql-pre-start[793]: Success. You can now start the database server using:1035gitlab # [ 9.076517] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1036gitlab # [ 9.169673] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1037gitlab # [ 9.171658] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 54321038gitlab # [ 9.172395] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 54321039gitlab # [ 9.176647] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1040gitlab # [ 9.194167] postgres[859]: [859] LOG: database system was shut down at 2026-10-03 06:56:51 GMT1041gitlab # [ 9.203098] postgres[850]: [850] LOG: database system is ready to accept connections1042gitlab # [ 9.208578] systemd[1]: Started PostgreSQL Server.1043gitlab # [ 9.212922] systemd[1]: Starting PostgreSQL Setup Scripts...1044gitlab # [ 9.308483] dhcpcd[765]: eth0: soliciting an IPv6 router1045gitlab # [ 9.309515] dhcpcd[765]: eth0: Router Advertisement from fe80::21046gitlab # [ 9.310370] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/641047gitlab # [ 9.311362] dhcpcd[765]: eth0: adding route to fec0::/641048gitlab # [ 9.312191] dhcpcd[765]: eth0: adding default route via fe80::21049gitlab # [ 9.436138] postgresql-setup-start[874]: CREATE DATABASE1050gitlab # [ 9.455875] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[873]: mkdir -p /var/gitlab/state/home/.ssh: OK1051gitlab # [ 9.459685] postgresql-setup-start[880]: CREATE ROLE1052gitlab # [ 9.460041] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[873]: chmod 700 /var/gitlab/state/home/.ssh: OK1053gitlab # [ 9.472782] postgresql-setup-start[884]: ALTER DATABASE1054gitlab # [ 9.492462] postgresql-setup-start[894]: CREATE ROLE1055gitlab # [ 9.497681] systemd[1]: Finished PostgreSQL Setup Scripts.1056gitlab # [ 9.499327] systemd[1]: Reached target PostgreSQL.1057gitlab # [ 9.501619] systemd[1]: Starting gitlab-postgresql.service...1058gitlab # [ 9.517506] systemd[1]: Finished gitlab-config.service.1059gitlab # [ 9.521580] systemd[1]: Started gitaly.service.1060gitlab # [ 9.526315] systemd[1]: Starting gitlab-db-config.service...1061gitlab # [ 9.602562] gitlab-postgresql-start[909]: CREATE DATABASE1062gitlab # [ 9.635099] gitlab-postgresql-start[925]: CREATE EXTENSION1063gitlab # [ 9.711779] gitlab-postgresql-start[927]: CREATE EXTENSION1064gitlab # [ 9.716291] systemd[1]: Finished gitlab-postgresql.service.1065gitlab # [ 10.065904] gitaly[905]: time="2026-10-03T06:56:53.272Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9051066gitlab # [ 10.067216] gitaly[905]: time="2026-10-03T06:56:53.273Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9051067gitlab # [ 10.068562] gitaly[905]: time="2026-10-03T06:56:53.273Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9051068gitlab # [ 10.069629] gitaly[905]: time="2026-10-03T06:56:53.273Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9051069gitlab # [ 10.071166] gitaly[905]: time="2026-10-03T06:56:53.273Z" level=info msg="Starting Gitaly" pid=905 version=1070gitlab # [ 10.254667] gitaly[905]: time="2026-10-03T06:56:53.462Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=166 pid=9051071gitlab # [ 10.254956] gitaly[905]: time="2026-10-03T06:56:53.462Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9051072gitlab # [ 10.258353] gitaly[905]: time="2026-10-03T06:56:53.466Z" level=info msg="finished initializing command factory" duration_ms=3 pid=9051073gitlab # [ 10.258676] gitaly[905]: time="2026-10-03T06:56:53.466Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-905/git-exec-2607517533.d/git pid=9051074gitlab # [ 10.265474] gitaly[905]: time="2026-10-03T06:56:53.473Z" level=info msg="finished detecting git version" duration_ms=7 pid=9051075gitlab # [ 10.265791] gitaly[905]: time="2026-10-03T06:56:53.473Z" level=info msg="using Git version" pid=905 version=2.53.g1076gitlab # [ 10.269252] gitaly[905]: time="2026-10-03T06:56:53.476Z" level=info msg="clearing disk cache object folder" pid=905 storage=default1077gitlab # [ 10.269673] gitaly[905]: time="2026-10-03T06:56:53.477Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1538542551 pid=905 storage=default1078gitlab # [ 10.270093] gitaly[905]: time="2026-10-03T06:56:53.477Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1538542551 pid=905 storage=default1079gitlab # [ 10.270692] gitaly[905]: time="2026-10-03T06:56:53.477Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9051080gitlab # [ 10.271135] gitaly[905]: time="2026-10-03T06:56:53.477Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9051081gitlab # [ 10.271667] gitaly[905]: time="2026-10-03T06:56:53.477Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1538542551 clear_duration_ms=0 pid=905 storage=default1082gitlab # [ 10.304473] gitaly[905]: time="2026-10-03T06:56:53.512Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9051083gitlab # [ 10.307192] gitaly[905]: time="2026-10-03T06:56:53.512Z" level=info msg="counting repositories" pid=9051084gitlab # [ 10.308813] gitaly[905]: time="2026-10-03T06:56:53.512Z" level=info msg="finished tempdir cleaner walk" pid=905 storage=default time_ms=01085gitlab # [ 10.309165] gitaly[905]: time="2026-10-03T06:56:53.512Z" level=info msg="starting to count repositories" pid=905 storage_path=/var/gitlab/state/repositories1086gitlab # [ 10.309489] gitaly[905]: time="2026-10-03T06:56:53.512Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=905 storage_path=/var/gitlab/state/repositories1087gitlab # [ 10.310099] gitaly[905]: time="2026-10-03T06:56:53.512Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9051088gitlab # [ 10.310787] gitaly[905]: time="2026-10-03T06:56:53.512Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=905 schema=unix1089gitlab # [ 10.311192] gitaly[905]: time="2026-10-03T06:56:53.512Z" level=info msg="listening at address" address=/run/gitaly/gitaly-905/sock.d/intern pid=905 schema=unix1090gitlab # [ 10.311749] gitaly[905]: time="2026-10-03T06:56:53.513Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9051091gitlab # [ 10.312643] gitaly[905]: time="2026-10-03T06:56:53.513Z" level=info msg="Started Gitaly" duration_ms=239 pid=9051092gitlab # [ 10.313257] gitaly[905]: time="2026-10-03T06:56:53.513Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9051093gitlab # [ 10.313872] gitaly[905]: time="2026-10-03T06:56:53.513Z" level=info msg="maintenance: daily scheduled" pid=905 scheduled="2026-10-03 12:00:00 +0000 UTC"1094gitlab # [ 11.040429] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1095gitlab # [ 11.047136] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1096gitlab # [ 11.069889] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1097gitlab # [ 12.150087] gitaly[905]: time="2026-10-03T06:56:55.356Z" level=info msg="License database preloaded" duration_ms=2083 pid=9051098gitlab # [ 13.213196] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds1099gitlab # [ 13.213596] dhcpcd[765]: eth0: adding route to 10.0.2.0/241100gitlab # [ 13.215487] dhcpcd[765]: eth0: adding default route via 10.0.2.21101gitlab # [ 13.324325] systemd[1]: Started DHCP Client.1102gitlab # [ 13.326196] systemd[1]: Reached target Network is Online.1103gitlab # [ 42.340456] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: W, [2026-10-03T06:57:25.547424 #916] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1104gitlab # [ 44.305308] postgres[1315]: [1315] ERROR: relation "feature_gates" does not exist at character 5231105gitlab # [ 44.305503] postgres[1315]: [1315] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1106gitlab # [ 44.306326] postgres[1315]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1107gitlab # [ 44.307410] postgres[1315]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1108gitlab # [ 44.308924] postgres[1315]: attidentity AS identity,1109gitlab # [ 44.310428] postgres[1315]: attgenerated as attgenerated1110gitlab # [ 44.311940] postgres[1315]: FROM pg_attribute a1111gitlab # [ 44.313433] postgres[1315]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1112gitlab # [ 44.314925] postgres[1315]: LEFT JOIN pg_type t ON a.atttypid = t.oid1113gitlab # [ 44.316046] postgres[1315]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1114gitlab # [ 44.317156] postgres[1315]: WHERE a.attrelid = '"feature_gates"'::regclass1115gitlab # [ 44.318273] postgres[1315]: AND a.attnum > 0 AND NOT a.attisdropped1116gitlab # [ 44.319394] postgres[1315]: ORDER BY a.attnum1117gitlab # [ 44.320968] postgres[1315]:1118gitlab # [ 48.162852] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1357]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 48.163319] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1357]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 48.321346] gitlab-workhorse[823]: time="2026-10-03T06:57:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 58.331609] gitlab-workhorse[823]: time="2026-10-03T06:57:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 63.325183] postgres[1432]: [1432] ERROR: relation "table_without_models" does not exist1123gitlab # [ 63.325789] postgres[1432]: [1432] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1124gitlab # [ 68.338505] gitlab-workhorse[823]: time="2026-10-03T06:57:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 75.302514] systemd[1]: Finished gitlab-db-config.service.1126gitlab # [ 75.308173] systemd[1]: Started gitlab-sidekiq.service.1127gitlab # [ 75.310969] systemd[1]: Starting gitlab.service...1128gitlab # [ 75.675591] bundle[1599]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1129gitlab # [ 75.676140] bundle[1599]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1130gitlab # [ 75.677561] bundle[1599]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1131gitlab # [ 78.306421] sidekiq-cluster[1598]: {"severity":"INFO","time":"2026-10-03T06:58:01.497Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 78.347456] gitlab-workhorse[823]: time="2026-10-03T06:58:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1133gitlab # [ 78.461634] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.646Z","pid":1599,"message":"* Enabling systemd notification integration"}1134gitlab # [ 78.462199] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"Puma starting in cluster mode..."}1135gitlab # [ 78.462951] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1136gitlab # [ 78.463669] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1137gitlab # [ 78.464452] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"* Min threads: 0"}1138gitlab # [ 78.465167] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"* Max threads: 4"}1139gitlab # [ 78.465928] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"* Environment: production"}1140gitlab # [ 78.466718] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"* Master PID: 1599"}1141gitlab # [ 78.467564] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"* Workers: 2"}1142gitlab # [ 78.468297] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1143gitlab # [ 78.469054] bundle[1599]: {"timestamp":"2026-10-03T06:58:01.668Z","pid":1599,"message":"* Preloading application"}1144gitlab # [ 88.356592] gitlab-workhorse[823]: time="2026-10-03T06:58:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 98.366738] gitlab-workhorse[823]: time="2026-10-03T06:58:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1146gitlab # [ 100.738325] bundle[1599]: W, [2026-10-03T06:58:23.945602 #1599] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 103.157391] sidekiq-cluster[1629]: 2026-10-03T06:58:26.364Z pid=1629 tid=wl1 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1629, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431255552}1148gitlab # [ 103.322863] sidekiq-cluster[1629]: W, [2026-10-03T06:58:26.530528 #1629] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1149gitlab # [ 103.360976] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:26.568Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1150gitlab # [ 105.300106] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.506Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 105.300718] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.507Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 105.321168] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.528Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 105.325854] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.533Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 105.329987] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.537Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 105.333765] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.541Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 105.338104] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.545Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 105.342363] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.550Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 105.346230] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.553Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 105.349349] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.557Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 105.352342] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.560Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 105.355680] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.563Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 105.358503] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.566Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 105.361878] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.569Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 105.364434] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.572Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 105.366880] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.574Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 105.369656] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.577Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 105.371745] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.579Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 105.373909] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.581Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 105.375898] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.583Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 105.378184] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.585Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 105.380253] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.587Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 105.382268] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.589Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 105.384262] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.591Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 105.386255] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.593Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 105.387869] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.595Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 105.389721] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.597Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 105.391778] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.599Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 105.393734] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.601Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 105.395838] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.603Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 105.397900] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.605Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 105.399879] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.607Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 105.401629] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.609Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 105.403660] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.611Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 105.405597] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.613Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 105.407594] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.615Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 105.409370] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.617Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 105.410992] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.618Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 105.413048] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.620Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 105.414980] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.622Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 105.416540] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.624Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 105.418269] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.625Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 105.419832] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.627Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 105.421537] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.629Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 105.423172] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.630Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 105.425106] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.632Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 105.427158] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.634Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 105.428804] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.636Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 105.430391] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.638Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 105.432153] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.639Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 105.434116] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.641Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 105.435964] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.643Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 105.437958] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.645Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 105.440373] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.648Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 105.448622] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.656Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 105.450820] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.658Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 105.452628] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.660Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 105.454437] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.662Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 105.456322] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.664Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 105.458753] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.666Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 105.461575] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.669Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 105.464643] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.672Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 105.467467] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.675Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 105.469950] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.677Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 105.473330] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.681Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 105.476462] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.684Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 105.479336] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.687Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 105.482467] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.690Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 105.516165] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.723Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 105.518819] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.726Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 105.521549] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.729Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 105.524163] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.731Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 105.527567] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.735Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 105.530062] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.737Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 105.532716] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.740Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 105.535573] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.743Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 105.538304] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.746Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 105.541286] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.749Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 105.543660] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.751Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 105.546502] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.754Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 105.548829] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.756Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 105.551487] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.759Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 105.554257] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.762Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 105.556394] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.764Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 105.560104] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.767Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 105.562541] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.770Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 105.565528] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.773Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 105.568066] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.775Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 105.571150] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.778Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 105.573500] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.780Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 105.575877] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.782Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 105.578171] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.784Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 105.580602] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.786Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 105.581366] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.789Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 105.583768] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.791Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 105.586529] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.794Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 105.589318] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.797Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 105.592351] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.800Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 105.594870] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.802Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 105.597286] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.805Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 105.607093] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.814Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 105.609323] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.817Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 105.611506] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.819Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 105.614848] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.822Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 105.617763] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.825Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 105.620242] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.828Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 105.623099] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.830Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 105.625207] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.832Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 105.627880] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.835Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 105.630714] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.838Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 105.634826] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:28.842Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 108.376610] gitlab-workhorse[823]: time="2026-10-03T06:58:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 118.377760] gitlab-workhorse[823]: time="2026-10-03T06:58:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 128.379412] gitlab-workhorse[823]: time="2026-10-03T06:58:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1264gitlab # [ 129.991595] postgres[2076]: [2076] ERROR: relation "table_without_models" does not exist1265gitlab # [ 129.994559] postgres[2076]: [2076] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1266gitlab # [ 130.205980] postgres[2086]: [2086] ERROR: relation "table_without_models" does not exist1267gitlab # [ 130.206574] postgres[2086]: [2086] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1268gitlab # [ 132.608894] bundle[1599]: {"timestamp":"2026-10-03T06:58:55.815Z","pid":1599,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1269gitlab # [ 132.610205] bundle[1599]: {"timestamp":"2026-10-03T06:58:55.815Z","pid":1599,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1270gitlab # [ 132.612252] bundle[1599]: {"timestamp":"2026-10-03T06:58:55.816Z","pid":1599,"message":"! #\u003cThread:0x000079c39d9c08d0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1271gitlab # [ 132.613748] bundle[1599]: {"timestamp":"2026-10-03T06:58:55.816Z","pid":1599,"message":"! #\u003cThread:0x000079c39dc6d628 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1272gitlab # [ 132.615649] bundle[1599]: {"timestamp":"2026-10-03T06:58:55.816Z","pid":1599,"message":"Use Ctrl-C to stop"}1273gitlab # [ 132.617239] bundle[1599]: {"timestamp":"2026-10-03T06:58:55.816Z","pid":1599,"message":"Sending status to systemd every 1.0 sec"}1274gitlab # [ 132.803452] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:56.010Z","message":"Booted Rails 7.2.3.1 application in production environment"}1275gitlab # [ 132.808316] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:56.016Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1276gitlab # [ 132.808524] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:56.016Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1277gitlab # [ 132.813058] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:56.017Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1278gitlab # [ 132.813842] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:56.019Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1279gitlab # [ 133.012923] bundle[1599]: {"timestamp":"2026-10-03T06:58:56.220Z","pid":1599,"message":"- Worker 1 (PID: 2166) booted in 0.32s, phase: 0"}1280gitlab # [ 133.019234] bundle[1599]: {"timestamp":"2026-10-03T06:58:56.226Z","pid":1599,"message":"- Worker 0 (PID: 2160) booted in 0.35s, phase: 0"}1281gitlab # [ 133.026631] systemd[1]: Started gitlab.service.1282gitlab # [ 133.026823] systemd[1]: Reached target Common target for all GitLab services..1283gitlab # [ 133.030412] systemd[1]: Starting setup-gitlab.service...1284gitlab # [ 133.046440] setup-gitlab-start[2190]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1285gitlab # [ 134.615529] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:57.821Z","message":"Cleaning working queues"}1286gitlab # [ 134.618994] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:57.826Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e0d1d1687d66bdc672246c82","created_at":"2026-10-03T06:57:58.236Z","trace_propagation_headers":{"sentry-trace":"ba3eff03ad23497886c46bc07938e9d8-f6d45ef7c18c463b","baggage":"sentry-trace_id=ba3eff03ad23497886c46bc07938e9d8,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1256ab76353df09f40ef72d4b931e14c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-03T06:57:58.243Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e0d1d1687d66bdc672246c82: start","job_status":"start","queue_duration_s":59.582814,"scheduling_latency_s":59.582892}1287gitlab # [ 134.837223] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:58:58.044Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e0d1d1687d66bdc672246c82","created_at":"2026-10-03T06:57:58.236Z","trace_propagation_headers":{"sentry-trace":"ba3eff03ad23497886c46bc07938e9d8-f6d45ef7c18c463b","baggage":"sentry-trace_id=ba3eff03ad23497886c46bc07938e9d8,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1256ab76353df09f40ef72d4b931e14c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-03T06:57:58.243Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e0d1d1687d66bdc672246c82: done: 0.218657 sec","job_status":"done","queue_duration_s":59.582814,"scheduling_latency_s":59.582892,"redis_calls":26,"redis_duration_s":0.008608,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.005221,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001894,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001493,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.099968851,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.218657,"completed_at":"2026-10-03T06:58:58.044Z","load_balancing_strategy":"primary","db_duration_s":0.064028,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1288gitlab # [ 135.258328] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:06:58:58 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 21851289gitlab # [ 135.263531] setup-gitlab-start[2190]: + TOKEN=nixbot-test-token-of-20-chars1290gitlab # [ 135.264263] setup-gitlab-start[2190]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1291gitlab # [ 135.290660] runuser[2215]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1292gitlab # [ 135.676215] setup-gitlab-start[2216]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 135.681262] setup-gitlab-start[2216]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 135.686247] setup-gitlab-start[2216]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 136.242629] setup-gitlab-start[2216]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1296gitlab # [ 136.247551] setup-gitlab-start[2216]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1297gitlab # [ 136.252300] setup-gitlab-start[2216]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1298gitlab # [ 145.067928] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7e23d2bdfb211f8ee9a1aaa2","created_at":"2026-10-03T06:59:08.240Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f499a352d63f4bc094ba755aa3b4f286","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.271Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7e23d2bdfb211f8ee9a1aaa2: start","job_status":"start","queue_duration_s":0.00284,"scheduling_latency_s":0.002881}1299gitlab # [ 145.330530] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7e23d2bdfb211f8ee9a1aaa2","created_at":"2026-10-03T06:59:08.240Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f499a352d63f4bc094ba755aa3b4f286","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.271Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7e23d2bdfb211f8ee9a1aaa2: done: 0.263651 sec","job_status":"done","queue_duration_s":0.00284,"scheduling_latency_s":0.002881,"redis_calls":14,"redis_duration_s":0.020596,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00959,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006425,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004581,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001886553,"exclusive_lock_hold_duration_s":0.103241333,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.263651,"completed_at":"2026-10-03T06:59:08.537Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 145.406168] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d011d6389ed733d3452f3f51","created_at":"2026-10-03T06:59:08.357Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef86f370d83075a3ef62a0009e93a06c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.373Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d011d6389ed733d3452f3f51: start","job_status":"start","queue_duration_s":0.239767,"scheduling_latency_s":0.239817}1301gitlab # [ 145.546534] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d011d6389ed733d3452f3f51","created_at":"2026-10-03T06:59:08.357Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef86f370d83075a3ef62a0009e93a06c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.373Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d011d6389ed733d3452f3f51: done: 0.140568 sec","job_status":"done","queue_duration_s":0.239767,"scheduling_latency_s":0.239817,"redis_calls":12,"redis_duration_s":0.04307,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001563,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.035389,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006118,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001691556,"exclusive_lock_hold_duration_s":0.030099915,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.140568,"completed_at":"2026-10-03T06:59:08.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 145.621127] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"bd4f8e1e7a12bdd12a7c8fff","created_at":"2026-10-03T06:59:08.396Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"485867211e3a4c4d3a5306992fd75ea0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.401Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-bd4f8e1e7a12bdd12a7c8fff: start","job_status":"start","queue_duration_s":0.357736,"scheduling_latency_s":0.357753}1303gitlab # [ 145.636826] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.793Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1304gitlab # [ 145.640912] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.812Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"bd4f8e1e7a12bdd12a7c8fff","created_at":"2026-10-03T06:59:08.396Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"485867211e3a4c4d3a5306992fd75ea0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.401Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-bd4f8e1e7a12bdd12a7c8fff: done: 0.053481 sec","job_status":"done","queue_duration_s":0.357736,"scheduling_latency_s":0.357753,"redis_calls":10,"redis_duration_s":0.01718,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000988,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014552,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00164,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000312888,"duration_s":0.053481,"completed_at":"2026-10-03T06:59:08.812Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 145.685464] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5261b962f1dbf311be3137cd","created_at":"2026-10-03T06:59:08.415Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e7c2740bf496aa9d4085dd8047a85e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-03T06:59:08.426Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5261b962f1dbf311be3137cd: start","job_status":"start","queue_duration_s":0.387318,"scheduling_latency_s":0.387336}1306gitlab # [ 145.699447] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5261b962f1dbf311be3137cd","created_at":"2026-10-03T06:59:08.415Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e7c2740bf496aa9d4085dd8047a85e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-03T06:59:08.426Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5261b962f1dbf311be3137cd: done: 0.026619 sec","job_status":"done","queue_duration_s":0.387318,"scheduling_latency_s":0.387336,"redis_calls":10,"redis_duration_s":0.001842,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000350045,"duration_s":0.026619,"completed_at":"2026-10-03T06:59:08.840Z","load_balancing_strategy":"primary","db_duration_s":0.004798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 145.700220] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5c0672627cb3394f2ea7abd8","created_at":"2026-10-03T06:59:08.445Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4f28624b40738ec03bb2d397facaa47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-03T06:59:08.453Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5c0672627cb3394f2ea7abd8: start","job_status":"start","queue_duration_s":0.390379,"scheduling_latency_s":0.390397}1308gitlab # [ 145.747434] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.857Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1309gitlab # [ 145.748303] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5c0672627cb3394f2ea7abd8","created_at":"2026-10-03T06:59:08.445Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4f28624b40738ec03bb2d397facaa47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-03T06:59:08.453Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5c0672627cb3394f2ea7abd8: done: 0.01918 sec","job_status":"done","queue_duration_s":0.390379,"scheduling_latency_s":0.390397,"redis_calls":10,"redis_duration_s":0.004193,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001332,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00137,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000322946,"duration_s":0.01918,"completed_at":"2026-10-03T06:59:08.863Z","load_balancing_strategy":"primary","db_duration_s":0.003604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 145.753369] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:08.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"556923bbe352d710be695128","created_at":"2026-10-03T06:59:08.467Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.477Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-556923bbe352d710be695128: start","job_status":"start","queue_duration_s":0.387109,"scheduling_latency_s":0.387123}1311gitlab # [ 145.902423] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"556923bbe352d710be695128","created_at":"2026-10-03T06:59:08.467Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.477Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-556923bbe352d710be695128: done: 0.245174 sec","job_status":"done","queue_duration_s":0.387109,"scheduling_latency_s":0.387123,"redis_calls":71,"redis_duration_s":0.023098999999999998,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.005983,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000953,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.015111,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.133,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.133,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000410108,"duration_s":0.245174,"completed_at":"2026-10-03T06:59:09.109Z","load_balancing_strategy":"primary","db_duration_s":0.132997,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 145.958834] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bca3565768d6e4dd97e11fa6","created_at":"2026-10-03T06:59:08.482Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.494Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bca3565768d6e4dd97e11fa6: start","job_status":"start","queue_duration_s":0.671412,"scheduling_latency_s":0.671449}1313gitlab # [ 145.997233] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bca3565768d6e4dd97e11fa6","created_at":"2026-10-03T06:59:08.482Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.494Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bca3565768d6e4dd97e11fa6: done: 0.038446 sec","job_status":"done","queue_duration_s":0.671412,"scheduling_latency_s":0.671449,"redis_calls":19,"redis_duration_s":0.005151,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001269,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000342,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002623,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000304508,"duration_s":0.038446,"completed_at":"2026-10-03T06:59:09.204Z","load_balancing_strategy":"primary","db_duration_s":0.002828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 145.998760] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b87198de9b4fe08217e3975c","created_at":"2026-10-03T06:59:08.500Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b30ce21f33ad253e9610f886cd89813","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.508Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b87198de9b4fe08217e3975c: start","job_status":"start","queue_duration_s":0.697295,"scheduling_latency_s":0.69731}1315gitlab # [ 146.071351] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b87198de9b4fe08217e3975c","created_at":"2026-10-03T06:59:08.500Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b30ce21f33ad253e9610f886cd89813","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.508Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b87198de9b4fe08217e3975c: done: 0.071707 sec","job_status":"done","queue_duration_s":0.697295,"scheduling_latency_s":0.69731,"redis_calls":12,"redis_duration_s":0.004203,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00174,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000561244,"duration_s":0.071707,"completed_at":"2026-10-03T06:59:09.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 146.111571] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"76ebd9451f5ca24908867e8f","created_at":"2026-10-03T06:59:08.520Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"273aded0cfffcd705f01ea75388ff856","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.531Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-76ebd9451f5ca24908867e8f: start","job_status":"start","queue_duration_s":0.787325,"scheduling_latency_s":0.787389}1317gitlab # [ 146.332367] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"76ebd9451f5ca24908867e8f","created_at":"2026-10-03T06:59:08.520Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"273aded0cfffcd705f01ea75388ff856","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.531Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-76ebd9451f5ca24908867e8f: done: 0.221433 sec","job_status":"done","queue_duration_s":0.787325,"scheduling_latency_s":0.787389,"redis_calls":12,"redis_duration_s":0.004219,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000892,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001576,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.036,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.162435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000939784,"exclusive_lock_hold_duration_s":0.188916749,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.221433,"completed_at":"2026-10-03T06:59:09.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.057633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 146.398861] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"172f2542d136bd832f06563b","created_at":"2026-10-03T06:59:08.610Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd2ff1c57c8bd2429e444c4eac4e7747","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.639Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-172f2542d136bd832f06563b: start","job_status":"start","queue_duration_s":0.901371,"scheduling_latency_s":0.901388}1319gitlab # [ 146.412153] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"172f2542d136bd832f06563b","created_at":"2026-10-03T06:59:08.610Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd2ff1c57c8bd2429e444c4eac4e7747","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.639Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-172f2542d136bd832f06563b: done: 0.057401 sec","job_status":"done","queue_duration_s":0.901371,"scheduling_latency_s":0.901388,"redis_calls":12,"redis_duration_s":0.00334,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000635,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001361,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000496991,"exclusive_lock_hold_duration_s":0.003147048,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.057401,"completed_at":"2026-10-03T06:59:09.598Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 146.452329] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6b0a680e2dfe6f13bf415b96","created_at":"2026-10-03T06:59:08.681Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21957b0cb57b7d74555bf630e2e2ad9a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.694Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6b0a680e2dfe6f13bf415b96: start","job_status":"start","queue_duration_s":0.905166,"scheduling_latency_s":0.90518}1321gitlab # [ 146.466651] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6b0a680e2dfe6f13bf415b96","created_at":"2026-10-03T06:59:08.681Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21957b0cb57b7d74555bf630e2e2ad9a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.694Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6b0a680e2dfe6f13bf415b96: done: 0.042039 sec","job_status":"done","queue_duration_s":0.905166,"scheduling_latency_s":0.90518,"redis_calls":13,"redis_duration_s":0.003631,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000904,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001657,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.012422807,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.042039,"completed_at":"2026-10-03T06:59:09.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002783,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1322gitlab # [ 146.489379] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f523fe2ad5b409798b36fe8c","created_at":"2026-10-03T06:59:08.701Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72d2bab082e63ab104b49f377d3ae3af","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.712Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f523fe2ad5b409798b36fe8c: start","job_status":"start","queue_duration_s":0.931544,"scheduling_latency_s":0.931571}1323gitlab # [ 146.714295] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:09.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f523fe2ad5b409798b36fe8c","created_at":"2026-10-03T06:59:08.701Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72d2bab082e63ab104b49f377d3ae3af","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.712Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f523fe2ad5b409798b36fe8c: done: 0.277269 sec","job_status":"done","queue_duration_s":0.931544,"scheduling_latency_s":0.931571,"redis_calls":565,"redis_duration_s":0.09506300000000001,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.093368,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.207485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000334121,"duration_s":0.277269,"completed_at":"2026-10-03T06:59:09.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 146.795032] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.002Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"754e7304d84b40f664ec31c7","created_at":"2026-10-03T06:59:08.722Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6633049a94dbb8d3f30e2d3ada60d5a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-03T06:59:08.726Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-754e7304d84b40f664ec31c7: start","job_status":"start","queue_duration_s":1.275519,"scheduling_latency_s":1.275566}1325gitlab # [ 146.819491] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.027Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1326gitlab # [ 146.832536] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"754e7304d84b40f664ec31c7","created_at":"2026-10-03T06:59:08.722Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6633049a94dbb8d3f30e2d3ada60d5a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-03T06:59:08.726Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-754e7304d84b40f664ec31c7: done: 0.037166 sec","job_status":"done","queue_duration_s":1.275519,"scheduling_latency_s":1.275566,"redis_calls":10,"redis_duration_s":0.003771,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00077,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002004,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000573816,"duration_s":0.037166,"completed_at":"2026-10-03T06:59:10.039Z","load_balancing_strategy":"primary","db_duration_s":0.001046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 146.835754] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a0edea1bab119cf454dd62b8","created_at":"2026-10-03T06:59:08.740Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"685e6fb2ec40964f7fa40269e020fe59","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.755Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a0edea1bab119cf454dd62b8: start","job_status":"start","queue_duration_s":1.287371,"scheduling_latency_s":1.287403}1328gitlab # [ 146.882030] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.089Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a0edea1bab119cf454dd62b8","created_at":"2026-10-03T06:59:08.740Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"685e6fb2ec40964f7fa40269e020fe59","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.755Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a0edea1bab119cf454dd62b8: done: 0.046101 sec","job_status":"done","queue_duration_s":1.287371,"scheduling_latency_s":1.287403,"redis_calls":12,"redis_duration_s":0.004743,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000616,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001997,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001146793,"exclusive_lock_hold_duration_s":0.012451303,"duration_s":0.046101,"completed_at":"2026-10-03T06:59:10.089Z","load_balancing_strategy":"primary","db_duration_s":0.006595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 146.885066] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8dbd8cc35734dd118cec9c7e","created_at":"2026-10-03T06:59:08.774Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da96b1a761b0668e431842898292c25d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.786Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8dbd8cc35734dd118cec9c7e: start","job_status":"start","queue_duration_s":1.305309,"scheduling_latency_s":1.305337}1330gitlab # [ 146.896380] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.104Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1331gitlab # [ 146.901616] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8dbd8cc35734dd118cec9c7e","created_at":"2026-10-03T06:59:08.774Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da96b1a761b0668e431842898292c25d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.786Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8dbd8cc35734dd118cec9c7e: done: 0.017654 sec","job_status":"done","queue_duration_s":1.305309,"scheduling_latency_s":1.305337,"redis_calls":10,"redis_duration_s":0.002169,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001037,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000853,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235784,"duration_s":0.017654,"completed_at":"2026-10-03T06:59:10.109Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 146.953063] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e38b6120ea0bef90c43aedcf","created_at":"2026-10-03T06:59:08.806Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"372a9288169521a8c799947b7da83d90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.832Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e38b6120ea0bef90c43aedcf: start","job_status":"start","queue_duration_s":1.278009,"scheduling_latency_s":1.27803}1333gitlab # [ 146.953766] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.117Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1334gitlab # [ 146.956914] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e38b6120ea0bef90c43aedcf","created_at":"2026-10-03T06:59:08.806Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"372a9288169521a8c799947b7da83d90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.832Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e38b6120ea0bef90c43aedcf: done: 0.012562 sec","job_status":"done","queue_duration_s":1.278009,"scheduling_latency_s":1.27803,"redis_calls":10,"redis_duration_s":0.001428,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000379937,"duration_s":0.012562,"completed_at":"2026-10-03T06:59:10.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 147.003801] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.123Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"521a80fc755131ad46a8401e","created_at":"2026-10-03T06:59:08.841Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15ad4e71f7fb0597037747cfa83b33f8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.848Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-521a80fc755131ad46a8401e: start","job_status":"start","queue_duration_s":1.274945,"scheduling_latency_s":1.274958}1336gitlab # [ 147.048077] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.143Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"521a80fc755131ad46a8401e","created_at":"2026-10-03T06:59:08.841Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15ad4e71f7fb0597037747cfa83b33f8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.848Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-521a80fc755131ad46a8401e: done: 0.020204 sec","job_status":"done","queue_duration_s":1.274945,"scheduling_latency_s":1.274958,"redis_calls":16,"redis_duration_s":0.002248,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001124,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217905,"duration_s":0.020204,"completed_at":"2026-10-03T06:59:10.143Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 147.051226] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"55703ec5214d26e0e80d43a3","created_at":"2026-10-03T06:59:08.856Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ef480bfe43beb88c08fd8ddb349c9da","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.873Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-55703ec5214d26e0e80d43a3: start","job_status":"start","queue_duration_s":1.271115,"scheduling_latency_s":1.271129}1338gitlab # [ 147.094408] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"55703ec5214d26e0e80d43a3","created_at":"2026-10-03T06:59:08.856Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ef480bfe43beb88c08fd8ddb349c9da","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.873Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-55703ec5214d26e0e80d43a3: done: 0.016055 sec","job_status":"done","queue_duration_s":1.271115,"scheduling_latency_s":1.271129,"redis_calls":10,"redis_duration_s":0.0013809999999999998,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207848,"duration_s":0.016055,"completed_at":"2026-10-03T06:59:10.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 147.105531] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ef8bbc1837b902dfafb4ab50","created_at":"2026-10-03T06:59:08.877Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347164cf920b913c3929565ee8eb6e9e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.880Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ef8bbc1837b902dfafb4ab50: start","job_status":"start","queue_duration_s":1.284773,"scheduling_latency_s":1.284789}1340gitlab # [ 147.119183] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ef8bbc1837b902dfafb4ab50","created_at":"2026-10-03T06:59:08.877Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347164cf920b913c3929565ee8eb6e9e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.880Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ef8bbc1837b902dfafb4ab50: done: 0.020888 sec","job_status":"done","queue_duration_s":1.284773,"scheduling_latency_s":1.284789,"redis_calls":10,"redis_duration_s":0.001569,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235226,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.020888,"completed_at":"2026-10-03T06:59:10.186Z","load_balancing_strategy":"primary","db_duration_s":0.005552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 147.163305] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.187Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"35f995edd37777c0476a9314","created_at":"2026-10-03T06:59:08.882Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa3fe6139ce37d5632594da1f77577a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.885Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-35f995edd37777c0476a9314: start","job_status":"start","queue_duration_s":1.301357,"scheduling_latency_s":1.301369}1342gitlab # [ 147.175125] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.195Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1343gitlab # [ 147.178680] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"35f995edd37777c0476a9314","created_at":"2026-10-03T06:59:08.882Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa3fe6139ce37d5632594da1f77577a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.885Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-35f995edd37777c0476a9314: done: 0.012995 sec","job_status":"done","queue_duration_s":1.301357,"scheduling_latency_s":1.301369,"redis_calls":10,"redis_duration_s":0.0013700000000000001,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022433,"duration_s":0.012995,"completed_at":"2026-10-03T06:59:10.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 147.224785] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"90f3e2365090229694dc0d1e","created_at":"2026-10-03T06:59:08.891Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98fd7dcd73f525cee8c36c6f62d3acac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.899Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-90f3e2365090229694dc0d1e: start","job_status":"start","queue_duration_s":1.302123,"scheduling_latency_s":1.302136}1345gitlab # [ 147.234086] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"90f3e2365090229694dc0d1e","created_at":"2026-10-03T06:59:08.891Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-29c51421de854c97","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98fd7dcd73f525cee8c36c6f62d3acac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:08.899Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-90f3e2365090229694dc0d1e: done: 0.012571 sec","job_status":"done","queue_duration_s":1.302123,"scheduling_latency_s":1.302136,"redis_calls":10,"redis_duration_s":0.001449,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000278527,"duration_s":0.012571,"completed_at":"2026-10-03T06:59:10.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 147.313890] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0b1d19e5f86d5d695e74606","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0b1d19e5f86d5d695e74606: start","job_status":"start","queue_duration_s":1.113171,"scheduling_latency_s":1.113185}1347gitlab # [ 147.314737] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0b1d19e5f86d5d695e74606","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0b1d19e5f86d5d695e74606: done: 0.015032 sec","job_status":"done","queue_duration_s":1.113171,"scheduling_latency_s":1.113185,"redis_calls":16,"redis_duration_s":0.0022329999999999997,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001302,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234666,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015032,"completed_at":"2026-10-03T06:59:10.230Z","load_balancing_strategy":"primary","db_duration_s":0.000257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 147.326946] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"849e3464cfde64d0e83fcebd","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-849e3464cfde64d0e83fcebd: start","job_status":"start","queue_duration_s":1.12926,"scheduling_latency_s":1.129274}1349gitlab # [ 147.338205] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"849e3464cfde64d0e83fcebd","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-849e3464cfde64d0e83fcebd: done: 0.010368 sec","job_status":"done","queue_duration_s":1.12926,"scheduling_latency_s":1.129274,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010368,"completed_at":"2026-10-03T06:59:10.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 147.383590] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ceca6248ab9c23a1478c39bf","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ceca6248ab9c23a1478c39bf: start","job_status":"start","queue_duration_s":1.140683,"scheduling_latency_s":1.140699}1351gitlab # [ 147.384300] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ceca6248ab9c23a1478c39bf","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ceca6248ab9c23a1478c39bf: done: 0.009977 sec","job_status":"done","queue_duration_s":1.140683,"scheduling_latency_s":1.140699,"redis_calls":13,"redis_duration_s":0.001672,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009977,"completed_at":"2026-10-03T06:59:10.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 147.426779] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b97e546204a8316355e7d15","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b97e546204a8316355e7d15: start","job_status":"start","queue_duration_s":1.151521,"scheduling_latency_s":1.151535}1353gitlab # [ 147.433491] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b97e546204a8316355e7d15","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b97e546204a8316355e7d15: done: 0.010512 sec","job_status":"done","queue_duration_s":1.151521,"scheduling_latency_s":1.151535,"redis_calls":13,"redis_duration_s":0.001939,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010512,"completed_at":"2026-10-03T06:59:10.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 147.486080] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c593caf560b6b7f6fa60a326","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c593caf560b6b7f6fa60a326: start","job_status":"start","queue_duration_s":1.162933,"scheduling_latency_s":1.162946}1355gitlab # [ 147.486910] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c593caf560b6b7f6fa60a326","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c593caf560b6b7f6fa60a326: done: 0.010837 sec","job_status":"done","queue_duration_s":1.162933,"scheduling_latency_s":1.162946,"redis_calls":13,"redis_duration_s":0.00198,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001431,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010837,"completed_at":"2026-10-03T06:59:10.275Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 147.529353] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98da8dde6cf91a02ead26343","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98da8dde6cf91a02ead26343: start","job_status":"start","queue_duration_s":1.174726,"scheduling_latency_s":1.174739}1357gitlab # [ 147.531652] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98da8dde6cf91a02ead26343","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98da8dde6cf91a02ead26343: done: 0.010114 sec","job_status":"done","queue_duration_s":1.174726,"scheduling_latency_s":1.174739,"redis_calls":13,"redis_duration_s":0.001682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010114,"completed_at":"2026-10-03T06:59:10.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 147.592908] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"788b499adfadedb5e8e894dc","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-788b499adfadedb5e8e894dc: start","job_status":"start","queue_duration_s":1.185711,"scheduling_latency_s":1.185724}1359gitlab # [ 147.593769] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"788b499adfadedb5e8e894dc","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-788b499adfadedb5e8e894dc: done: 0.013071 sec","job_status":"done","queue_duration_s":1.185711,"scheduling_latency_s":1.185724,"redis_calls":13,"redis_duration_s":0.001923,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013071,"completed_at":"2026-10-03T06:59:10.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 147.619822] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec556f0cbd1cf715d035530","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec556f0cbd1cf715d035530: start","job_status":"start","queue_duration_s":1.200077,"scheduling_latency_s":1.200097}1361gitlab # [ 147.632064] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec556f0cbd1cf715d035530","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec556f0cbd1cf715d035530: done: 0.011208 sec","job_status":"done","queue_duration_s":1.200077,"scheduling_latency_s":1.200097,"redis_calls":13,"redis_duration_s":0.001682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011208,"completed_at":"2026-10-03T06:59:10.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 147.670077] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d87eb33f2362cf2aed79ac5","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d87eb33f2362cf2aed79ac5: start","job_status":"start","queue_duration_s":1.212136,"scheduling_latency_s":1.21215}1363gitlab # [ 147.682536] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d87eb33f2362cf2aed79ac5","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d87eb33f2362cf2aed79ac5: done: 0.010192 sec","job_status":"done","queue_duration_s":1.212136,"scheduling_latency_s":1.21215,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010192,"completed_at":"2026-10-03T06:59:10.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 147.726844] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d46ee611b4f98f1d938482a1","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d46ee611b4f98f1d938482a1: start","job_status":"start","queue_duration_s":1.223363,"scheduling_latency_s":1.22338}1365gitlab # [ 147.729110] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d46ee611b4f98f1d938482a1","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d46ee611b4f98f1d938482a1: done: 0.011332 sec","job_status":"done","queue_duration_s":1.223363,"scheduling_latency_s":1.22338,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011332,"completed_at":"2026-10-03T06:59:10.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 147.785129] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33ca31a56ebb72ffcaeef67e","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33ca31a56ebb72ffcaeef67e: start","job_status":"start","queue_duration_s":1.235865,"scheduling_latency_s":1.235879}1367gitlab # [ 147.786044] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33ca31a56ebb72ffcaeef67e","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33ca31a56ebb72ffcaeef67e: done: 0.010088 sec","job_status":"done","queue_duration_s":1.235865,"scheduling_latency_s":1.235879,"redis_calls":13,"redis_duration_s":0.0016680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010088,"completed_at":"2026-10-03T06:59:10.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 147.825342] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36dd90274c20dbd08d203b81","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36dd90274c20dbd08d203b81: start","job_status":"start","queue_duration_s":1.24696,"scheduling_latency_s":1.246974}1369gitlab # [ 147.826303] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36dd90274c20dbd08d203b81","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36dd90274c20dbd08d203b81: done: 0.010387 sec","job_status":"done","queue_duration_s":1.24696,"scheduling_latency_s":1.246974,"redis_calls":13,"redis_duration_s":0.001881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000595,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001286,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010387,"completed_at":"2026-10-03T06:59:10.359Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 147.868815] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"856724c8857c13d14c26220a","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-856724c8857c13d14c26220a: start","job_status":"start","queue_duration_s":1.258402,"scheduling_latency_s":1.258414}1371gitlab # [ 147.869963] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"856724c8857c13d14c26220a","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-856724c8857c13d14c26220a: done: 0.010524 sec","job_status":"done","queue_duration_s":1.258402,"scheduling_latency_s":1.258414,"redis_calls":13,"redis_duration_s":0.0021660000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010524,"completed_at":"2026-10-03T06:59:10.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 147.918826] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"368176c62cf8e9dd9e8d1727","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-368176c62cf8e9dd9e8d1727: start","job_status":"start","queue_duration_s":1.270092,"scheduling_latency_s":1.270105}1373gitlab # [ 147.919848] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"368176c62cf8e9dd9e8d1727","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-368176c62cf8e9dd9e8d1727: done: 0.010252 sec","job_status":"done","queue_duration_s":1.270092,"scheduling_latency_s":1.270105,"redis_calls":13,"redis_duration_s":0.001891,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010252,"completed_at":"2026-10-03T06:59:10.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 147.983412] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4a14b54b7972de400caebfa","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4a14b54b7972de400caebfa: start","job_status":"start","queue_duration_s":1.281201,"scheduling_latency_s":1.281216}1375gitlab # [ 147.984284] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4a14b54b7972de400caebfa","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4a14b54b7972de400caebfa: done: 0.010085 sec","job_status":"done","queue_duration_s":1.281201,"scheduling_latency_s":1.281216,"redis_calls":13,"redis_duration_s":0.0016849999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010085,"completed_at":"2026-10-03T06:59:10.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 148.038117] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95746a2b63164998d196fda2","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95746a2b63164998d196fda2: start","job_status":"start","queue_duration_s":1.292219,"scheduling_latency_s":1.292233}1377gitlab # [ 148.039098] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95746a2b63164998d196fda2","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95746a2b63164998d196fda2: done: 0.010348 sec","job_status":"done","queue_duration_s":1.292219,"scheduling_latency_s":1.292233,"redis_calls":13,"redis_duration_s":0.002035,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001467,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010348,"completed_at":"2026-10-03T06:59:10.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 148.047691] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a7501f74efe126aaffa3df6","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a7501f74efe126aaffa3df6: start","job_status":"start","queue_duration_s":1.303467,"scheduling_latency_s":1.303482}1379gitlab # [ 148.091374] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a7501f74efe126aaffa3df6","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a7501f74efe126aaffa3df6: done: 0.010273 sec","job_status":"done","queue_duration_s":1.303467,"scheduling_latency_s":1.303482,"redis_calls":13,"redis_duration_s":0.001654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010273,"completed_at":"2026-10-03T06:59:10.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 148.094767] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e45583e24b7361c54c959a1","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e45583e24b7361c54c959a1: start","job_status":"start","queue_duration_s":1.314686,"scheduling_latency_s":1.314701}1381gitlab # [ 148.140189] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e45583e24b7361c54c959a1","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e45583e24b7361c54c959a1: done: 0.010036 sec","job_status":"done","queue_duration_s":1.314686,"scheduling_latency_s":1.314701,"redis_calls":13,"redis_duration_s":0.001609,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010036,"completed_at":"2026-10-03T06:59:10.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 148.141595] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0fdb5bd1ad234fbb483f1d8","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0fdb5bd1ad234fbb483f1d8: start","job_status":"start","queue_duration_s":1.325595,"scheduling_latency_s":1.325609}1383gitlab # [ 148.188479] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0fdb5bd1ad234fbb483f1d8","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0fdb5bd1ad234fbb483f1d8: done: 0.010353 sec","job_status":"done","queue_duration_s":1.325595,"scheduling_latency_s":1.325609,"redis_calls":13,"redis_duration_s":0.0017130000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010353,"completed_at":"2026-10-03T06:59:10.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 148.189761] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a38f60f499aba026e7ae5c8","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a38f60f499aba026e7ae5c8: start","job_status":"start","queue_duration_s":1.337002,"scheduling_latency_s":1.337041}1385gitlab # [ 148.233255] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a38f60f499aba026e7ae5c8","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a38f60f499aba026e7ae5c8: done: 0.010588 sec","job_status":"done","queue_duration_s":1.337002,"scheduling_latency_s":1.337041,"redis_calls":13,"redis_duration_s":0.001732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010588,"completed_at":"2026-10-03T06:59:10.449Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 148.234666] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acadf1982aad45faa1dbeac7","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acadf1982aad45faa1dbeac7: start","job_status":"start","queue_duration_s":1.348608,"scheduling_latency_s":1.348621}1387gitlab # [ 148.245699] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acadf1982aad45faa1dbeac7","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acadf1982aad45faa1dbeac7: done: 0.010058 sec","job_status":"done","queue_duration_s":1.348608,"scheduling_latency_s":1.348621,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010058,"completed_at":"2026-10-03T06:59:10.460Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 148.293450] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f0b7b5a8cc4ec6d9ef4f761","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f0b7b5a8cc4ec6d9ef4f761: start","job_status":"start","queue_duration_s":1.359739,"scheduling_latency_s":1.359754}1389gitlab # [ 148.294286] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f0b7b5a8cc4ec6d9ef4f761","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f0b7b5a8cc4ec6d9ef4f761: done: 0.009979 sec","job_status":"done","queue_duration_s":1.359739,"scheduling_latency_s":1.359754,"redis_calls":13,"redis_duration_s":0.001589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009979,"completed_at":"2026-10-03T06:59:10.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 148.335542] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ae6bf95874ab2dac8a0ebf3","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ae6bf95874ab2dac8a0ebf3: start","job_status":"start","queue_duration_s":1.370749,"scheduling_latency_s":1.370764}1391gitlab # [ 148.338194] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ae6bf95874ab2dac8a0ebf3","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ae6bf95874ab2dac8a0ebf3: done: 0.009971 sec","job_status":"done","queue_duration_s":1.370749,"scheduling_latency_s":1.370764,"redis_calls":13,"redis_duration_s":0.0017399999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009971,"completed_at":"2026-10-03T06:59:10.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 148.377646] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ded65fa8196c2c6ff3923ba","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ded65fa8196c2c6ff3923ba: start","job_status":"start","queue_duration_s":1.38192,"scheduling_latency_s":1.381935}1393gitlab # [ 148.422415] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ded65fa8196c2c6ff3923ba","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ded65fa8196c2c6ff3923ba: done: 0.009998 sec","job_status":"done","queue_duration_s":1.38192,"scheduling_latency_s":1.381935,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009998,"completed_at":"2026-10-03T06:59:10.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 148.423704] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d71d9fc55367707e46d266c","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d71d9fc55367707e46d266c: start","job_status":"start","queue_duration_s":1.392848,"scheduling_latency_s":1.392864}1395gitlab # [ 148.430722] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d71d9fc55367707e46d266c","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d71d9fc55367707e46d266c: done: 0.010609 sec","job_status":"done","queue_duration_s":1.392848,"scheduling_latency_s":1.392864,"redis_calls":13,"redis_duration_s":0.001989,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001426,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010609,"completed_at":"2026-10-03T06:59:10.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 148.483529] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9304de428c213a0d3d5e589","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9304de428c213a0d3d5e589: start","job_status":"start","queue_duration_s":1.404324,"scheduling_latency_s":1.404338}1397gitlab # [ 148.484547] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9304de428c213a0d3d5e589","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9304de428c213a0d3d5e589: done: 0.010249 sec","job_status":"done","queue_duration_s":1.404324,"scheduling_latency_s":1.404338,"redis_calls":13,"redis_duration_s":0.001923,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010249,"completed_at":"2026-10-03T06:59:10.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 148.552325] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"179b8229c167d91b247f1e82","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-179b8229c167d91b247f1e82: start","job_status":"start","queue_duration_s":1.415445,"scheduling_latency_s":1.415459}1399gitlab # [ 148.553232] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"179b8229c167d91b247f1e82","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-179b8229c167d91b247f1e82: done: 0.071368 sec","job_status":"done","queue_duration_s":1.415445,"scheduling_latency_s":1.415459,"redis_calls":13,"redis_duration_s":0.0018549999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.071368,"completed_at":"2026-10-03T06:59:10.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 148.595398] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5fcdb3b8650cd2d5ea90d65","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5fcdb3b8650cd2d5ea90d65: start","job_status":"start","queue_duration_s":1.488269,"scheduling_latency_s":1.488298}1401gitlab # [ 148.596321] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5fcdb3b8650cd2d5ea90d65","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5fcdb3b8650cd2d5ea90d65: done: 0.012219 sec","job_status":"done","queue_duration_s":1.488269,"scheduling_latency_s":1.488298,"redis_calls":13,"redis_duration_s":0.001754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012219,"completed_at":"2026-10-03T06:59:10.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 148.609789] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55e8819a137bdcf790c921f1","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55e8819a137bdcf790c921f1: start","job_status":"start","queue_duration_s":1.501398,"scheduling_latency_s":1.501413}1403gitlab # [ 148.622212] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55e8819a137bdcf790c921f1","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55e8819a137bdcf790c921f1: done: 0.01315 sec","job_status":"done","queue_duration_s":1.501398,"scheduling_latency_s":1.501413,"redis_calls":13,"redis_duration_s":0.0021939999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001387,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01315,"completed_at":"2026-10-03T06:59:10.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 148.689786] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34056f0fccde53607321314d","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34056f0fccde53607321314d: start","job_status":"start","queue_duration_s":1.515834,"scheduling_latency_s":1.515855}1405gitlab # [ 148.691080] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34056f0fccde53607321314d","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34056f0fccde53607321314d: done: 0.010187 sec","job_status":"done","queue_duration_s":1.515834,"scheduling_latency_s":1.515855,"redis_calls":13,"redis_duration_s":0.001655,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010187,"completed_at":"2026-10-03T06:59:10.627Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 148.737353] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce05a22507a883297f250abd","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce05a22507a883297f250abd: start","job_status":"start","queue_duration_s":1.52774,"scheduling_latency_s":1.52776}1407gitlab # [ 148.738179] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce05a22507a883297f250abd","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce05a22507a883297f250abd: done: 0.012171 sec","job_status":"done","queue_duration_s":1.52774,"scheduling_latency_s":1.52776,"redis_calls":13,"redis_duration_s":0.0017890000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012171,"completed_at":"2026-10-03T06:59:10.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 148.754570] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c5e93df3d52d564881751c2","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c5e93df3d52d564881751c2: start","job_status":"start","queue_duration_s":1.540773,"scheduling_latency_s":1.540787}1409gitlab # [ 148.804549] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c5e93df3d52d564881751c2","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c5e93df3d52d564881751c2: done: 0.009964 sec","job_status":"done","queue_duration_s":1.540773,"scheduling_latency_s":1.540787,"redis_calls":13,"redis_duration_s":0.00161,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009964,"completed_at":"2026-10-03T06:59:10.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 148.806099] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1418c99c37e412b7e043da88","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1418c99c37e412b7e043da88: start","job_status":"start","queue_duration_s":1.551711,"scheduling_latency_s":1.551725}1411gitlab # [ 148.850488] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1418c99c37e412b7e043da88","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1418c99c37e412b7e043da88: done: 0.009803 sec","job_status":"done","queue_duration_s":1.551711,"scheduling_latency_s":1.551725,"redis_calls":13,"redis_duration_s":0.001758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009803,"completed_at":"2026-10-03T06:59:10.663Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 148.852063] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e9466cc5d9f8de09fa43a3b","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e9466cc5d9f8de09fa43a3b: start","job_status":"start","queue_duration_s":1.562406,"scheduling_latency_s":1.562421}1413gitlab # [ 148.860483] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e9466cc5d9f8de09fa43a3b","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e9466cc5d9f8de09fa43a3b: done: 0.009548 sec","job_status":"done","queue_duration_s":1.562406,"scheduling_latency_s":1.562421,"redis_calls":13,"redis_duration_s":0.001656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009548,"completed_at":"2026-10-03T06:59:10.673Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 148.924866] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ed47923beb6106437994fac","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ed47923beb6106437994fac: start","job_status":"start","queue_duration_s":1.573243,"scheduling_latency_s":1.573257}1415gitlab # [ 148.925897] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ed47923beb6106437994fac","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ed47923beb6106437994fac: done: 0.009488 sec","job_status":"done","queue_duration_s":1.573243,"scheduling_latency_s":1.573257,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009488,"completed_at":"2026-10-03T06:59:10.684Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 148.969567] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac0b1586d45e22e53dcf718f","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac0b1586d45e22e53dcf718f: start","job_status":"start","queue_duration_s":1.583698,"scheduling_latency_s":1.583711}1417gitlab # [ 148.970562] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac0b1586d45e22e53dcf718f","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac0b1586d45e22e53dcf718f: done: 0.009688 sec","job_status":"done","queue_duration_s":1.583698,"scheduling_latency_s":1.583711,"redis_calls":13,"redis_duration_s":0.0021190000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001475,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009688,"completed_at":"2026-10-03T06:59:10.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 148.994323] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e13bcf0b82e45bc805d6d6ea","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e13bcf0b82e45bc805d6d6ea: start","job_status":"start","queue_duration_s":1.594272,"scheduling_latency_s":1.594293}1419gitlab # [ 149.034097] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e13bcf0b82e45bc805d6d6ea","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e13bcf0b82e45bc805d6d6ea: done: 0.011949 sec","job_status":"done","queue_duration_s":1.594272,"scheduling_latency_s":1.594293,"redis_calls":13,"redis_duration_s":0.001987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011949,"completed_at":"2026-10-03T06:59:10.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 149.075947] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99005f93db478a200722801b","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99005f93db478a200722801b: start","job_status":"start","queue_duration_s":1.607634,"scheduling_latency_s":1.607657}1421gitlab # [ 149.076863] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99005f93db478a200722801b","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99005f93db478a200722801b: done: 0.011077 sec","job_status":"done","queue_duration_s":1.607634,"scheduling_latency_s":1.607657,"redis_calls":13,"redis_duration_s":0.001754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011077,"completed_at":"2026-10-03T06:59:10.720Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 149.123952] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cd312581a017f94980d48ef","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cd312581a017f94980d48ef: start","job_status":"start","queue_duration_s":1.619963,"scheduling_latency_s":1.619976}1423gitlab # [ 149.124815] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cd312581a017f94980d48ef","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cd312581a017f94980d48ef: done: 0.009486 sec","job_status":"done","queue_duration_s":1.619963,"scheduling_latency_s":1.619976,"redis_calls":13,"redis_duration_s":0.001667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009486,"completed_at":"2026-10-03T06:59:10.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 149.168228] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f4da4660a98f80792a6d50e","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f4da4660a98f80792a6d50e: start","job_status":"start","queue_duration_s":1.630328,"scheduling_latency_s":1.630342}1425gitlab # [ 149.168882] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f4da4660a98f80792a6d50e","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f4da4660a98f80792a6d50e: done: 0.009457 sec","job_status":"done","queue_duration_s":1.630328,"scheduling_latency_s":1.630342,"redis_calls":13,"redis_duration_s":0.0018119999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001261,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009457,"completed_at":"2026-10-03T06:59:10.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 149.209204] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9e78aa0cdc596a78d9cfb01","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9e78aa0cdc596a78d9cfb01: start","job_status":"start","queue_duration_s":1.640645,"scheduling_latency_s":1.640658}1427gitlab # [ 149.210076] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9e78aa0cdc596a78d9cfb01","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9e78aa0cdc596a78d9cfb01: done: 0.009334 sec","job_status":"done","queue_duration_s":1.640645,"scheduling_latency_s":1.640658,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009334,"completed_at":"2026-10-03T06:59:10.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 149.253435] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81f8a1a850c2b425dda2e373","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81f8a1a850c2b425dda2e373: start","job_status":"start","queue_duration_s":1.650814,"scheduling_latency_s":1.650827}1429gitlab # [ 149.254513] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81f8a1a850c2b425dda2e373","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81f8a1a850c2b425dda2e373: done: 0.009702 sec","job_status":"done","queue_duration_s":1.650814,"scheduling_latency_s":1.650827,"redis_calls":13,"redis_duration_s":0.001718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009702,"completed_at":"2026-10-03T06:59:10.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 149.298976] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51e57c62f4e62e3f3fbef4fc","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51e57c62f4e62e3f3fbef4fc: start","job_status":"start","queue_duration_s":1.661397,"scheduling_latency_s":1.66141}1431gitlab # [ 149.299925] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51e57c62f4e62e3f3fbef4fc","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51e57c62f4e62e3f3fbef4fc: done: 0.009334 sec","job_status":"done","queue_duration_s":1.661397,"scheduling_latency_s":1.66141,"redis_calls":13,"redis_duration_s":0.0016970000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009334,"completed_at":"2026-10-03T06:59:10.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 149.320795] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d10e12cbb5e67d194d1e70f","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d10e12cbb5e67d194d1e70f: start","job_status":"start","queue_duration_s":1.671599,"scheduling_latency_s":1.671612}1433gitlab # [ 149.332797] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d10e12cbb5e67d194d1e70f","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d10e12cbb5e67d194d1e70f: done: 0.009513 sec","job_status":"done","queue_duration_s":1.671599,"scheduling_latency_s":1.671612,"redis_calls":13,"redis_duration_s":0.001654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009513,"completed_at":"2026-10-03T06:59:10.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 149.389879] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ec17ec68af85e221bb49e87","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ec17ec68af85e221bb49e87: start","job_status":"start","queue_duration_s":1.68195,"scheduling_latency_s":1.681963}1435gitlab # [ 149.390762] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ec17ec68af85e221bb49e87","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ec17ec68af85e221bb49e87: done: 0.009374 sec","job_status":"done","queue_duration_s":1.68195,"scheduling_latency_s":1.681963,"redis_calls":13,"redis_duration_s":0.0016849999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009374,"completed_at":"2026-10-03T06:59:10.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 149.438716] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"059fa19ac3a40e855ec9360c","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-059fa19ac3a40e855ec9360c: start","job_status":"start","queue_duration_s":1.692644,"scheduling_latency_s":1.69266}1437gitlab # [ 149.439433] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"059fa19ac3a40e855ec9360c","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-059fa19ac3a40e855ec9360c: done: 0.010052 sec","job_status":"done","queue_duration_s":1.692644,"scheduling_latency_s":1.69266,"redis_calls":13,"redis_duration_s":0.001865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010052,"completed_at":"2026-10-03T06:59:10.804Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 149.483879] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4edeeba59e93cf9677b6f6f3","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4edeeba59e93cf9677b6f6f3: start","job_status":"start","queue_duration_s":1.703157,"scheduling_latency_s":1.703169}1439gitlab # [ 149.484804] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4edeeba59e93cf9677b6f6f3","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4edeeba59e93cf9677b6f6f3: done: 0.009297 sec","job_status":"done","queue_duration_s":1.703157,"scheduling_latency_s":1.703169,"redis_calls":13,"redis_duration_s":0.001574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009297,"completed_at":"2026-10-03T06:59:10.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 149.533153] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d47ea95ef4261a5d52f35a6b","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d47ea95ef4261a5d52f35a6b: start","job_status":"start","queue_duration_s":1.713334,"scheduling_latency_s":1.713348}1441gitlab # [ 149.533958] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d47ea95ef4261a5d52f35a6b","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d47ea95ef4261a5d52f35a6b: done: 0.009296 sec","job_status":"done","queue_duration_s":1.713334,"scheduling_latency_s":1.713348,"redis_calls":13,"redis_duration_s":0.0016060000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009296,"completed_at":"2026-10-03T06:59:10.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 149.583122] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10c20df9c292dd11af7210ea","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10c20df9c292dd11af7210ea: start","job_status":"start","queue_duration_s":1.723479,"scheduling_latency_s":1.723492}1443gitlab # [ 149.583910] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10c20df9c292dd11af7210ea","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10c20df9c292dd11af7210ea: done: 0.010255 sec","job_status":"done","queue_duration_s":1.723479,"scheduling_latency_s":1.723492,"redis_calls":13,"redis_duration_s":0.002124,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010255,"completed_at":"2026-10-03T06:59:10.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 149.627531] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39336fbd5adef5a5466e496","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39336fbd5adef5a5466e496: start","job_status":"start","queue_duration_s":1.734972,"scheduling_latency_s":1.734986}1445gitlab # [ 149.628448] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39336fbd5adef5a5466e496","created_at":"2026-10-03T06:59:09.019Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-07a1a85e36f34135","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"27def69c366902cd5752747549dc3e14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.101Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39336fbd5adef5a5466e496: done: 0.009372 sec","job_status":"done","queue_duration_s":1.734972,"scheduling_latency_s":1.734986,"redis_calls":13,"redis_duration_s":0.001609,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009372,"completed_at":"2026-10-03T06:59:10.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 149.671792] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.847Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1abe653db0ad82ea392b4ed4","created_at":"2026-10-03T06:59:09.187Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-32819fec1ea64708","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.198Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1abe653db0ad82ea392b4ed4: start","job_status":"start","queue_duration_s":1.648073,"scheduling_latency_s":1.648086}1447gitlab # [ 149.672822] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.857Z","message":"No existing merge request to be cleaned up."}1448gitlab # [ 149.673630] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.864Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1abe653db0ad82ea392b4ed4","created_at":"2026-10-03T06:59:09.187Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-32819fec1ea64708","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.198Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1abe653db0ad82ea392b4ed4: done: 0.01785 sec","job_status":"done","queue_duration_s":1.648073,"scheduling_latency_s":1.648086,"redis_calls":13,"redis_duration_s":0.0017560000000000002,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213994,"duration_s":0.01785,"completed_at":"2026-10-03T06:59:10.864Z","load_balancing_strategy":"primary","db_duration_s":0.002266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 149.726483] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.865Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"66920a0edb95a258ee9d1d4e","created_at":"2026-10-03T06:59:09.187Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-32819fec1ea64708","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.198Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-66920a0edb95a258ee9d1d4e: start","job_status":"start","queue_duration_s":1.666781,"scheduling_latency_s":1.666794}1450gitlab # [ 149.727310] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.872Z","message":"No existing merge request to be cleaned up."}1451gitlab # [ 149.728264] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.877Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"66920a0edb95a258ee9d1d4e","created_at":"2026-10-03T06:59:09.187Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-32819fec1ea64708","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.198Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-66920a0edb95a258ee9d1d4e: done: 0.011308 sec","job_status":"done","queue_duration_s":1.666781,"scheduling_latency_s":1.666794,"redis_calls":10,"redis_duration_s":0.001284,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011308,"completed_at":"2026-10-03T06:59:10.877Z","load_balancing_strategy":"primary","db_duration_s":0.000911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 149.772829] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.877Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3de21df07eb9f3a8abfbe0a2","created_at":"2026-10-03T06:59:09.187Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-32819fec1ea64708","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.198Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3de21df07eb9f3a8abfbe0a2: start","job_status":"start","queue_duration_s":1.678937,"scheduling_latency_s":1.678951}1453gitlab # [ 149.773666] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.884Z","message":"No existing merge request to be cleaned up."}1454gitlab # [ 149.774583] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.888Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3de21df07eb9f3a8abfbe0a2","created_at":"2026-10-03T06:59:09.187Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-32819fec1ea64708","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.198Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3de21df07eb9f3a8abfbe0a2: done: 0.01091 sec","job_status":"done","queue_duration_s":1.678937,"scheduling_latency_s":1.678951,"redis_calls":10,"redis_duration_s":0.001256,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000743,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01091,"completed_at":"2026-10-03T06:59:10.888Z","load_balancing_strategy":"primary","db_duration_s":0.000927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 149.832810] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.889Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2a586e42b730564339d04704","created_at":"2026-10-03T06:59:09.187Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-32819fec1ea64708","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.198Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2a586e42b730564339d04704: start","job_status":"start","queue_duration_s":1.69066,"scheduling_latency_s":1.690673}1456gitlab # [ 149.833854] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.896Z","message":"No existing merge request to be cleaned up."}1457gitlab # [ 149.834860] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:10.901Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2a586e42b730564339d04704","created_at":"2026-10-03T06:59:09.187Z","trace_propagation_headers":{"sentry-trace":"60819fe2b578447d84f38fa22a0a76b8-32819fec1ea64708","baggage":"sentry-trace_id=60819fe2b578447d84f38fa22a0a76b8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e45a89d8e89ff5a938b59a5d5462a41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-03T06:59:09.198Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"madl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2a586e42b730564339d04704: done: 0.011434 sec","job_status":"done","queue_duration_s":1.69066,"scheduling_latency_s":1.690673,"redis_calls":10,"redis_duration_s":0.001353,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011434,"completed_at":"2026-10-03T06:59:10.901Z","load_balancing_strategy":"primary","db_duration_s":0.00092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 150.030151] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1618961441 wd_nsec: 16189614541459gitlab # [ 160.762919] setup-gitlab-start[2216]: W, [2026-10-03T06:59:23.969610 #2216] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1460gitlab # [ 182.177606] postgres[2417]: [2417] ERROR: relation "table_without_models" does not exist1461gitlab # [ 182.178490] postgres[2417]: [2417] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1462gitlab # [ 185.649383] runuser[2215]: pam_unix(runuser:session): session closed for user gitlab1463gitlab # [ 185.650414] setup-gitlab-start[2190]: + systemctl restart gitlab-sidekiq.service1464gitlab # [ 185.676135] systemd[1]: Stopping gitlab-sidekiq.service...1465gitlab # [ 185.677559] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:48.884Z","message":"Shutting down"}1466gitlab # [ 185.678224] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:48.884Z","message":"Scheduler exiting..."}1467gitlab # [ 185.679913] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:48.885Z","message":"Terminating quiet threads for default capsule"}1468gitlab # [ 185.681467] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:48.885Z","message":"Scheduler exiting..."}1469gitlab # [ 186.179324] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:49.386Z","message":"Pausing to allow jobs to finish..."}1470gitlab # [ 188.183870] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:51.390Z","message":"Bye!"}1471gitlab # [ 188.209188] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-03T06:59:51.416Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1629,"worker_id":"sidekiq_0","memwd_rss_bytes":931950592,"retry":0}1472gitlab # [ 189.391163] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1473gitlab # [ 189.392107] systemd[1]: Stopped gitlab-sidekiq.service.1474gitlab # [ 189.393542] systemd[1]: gitlab-sidekiq.service: Consumed 57.984s CPU time over 1min 54.082s wall clock time, 953.6M memory peak, 4.2M read from disk.1475gitlab # [ 189.403376] systemd[1]: Started gitlab-sidekiq.service.1476gitlab # [ 189.407138] setup-gitlab-start[2190]: + mkdir -p /var/lib/secrets1477gitlab # [ 189.410338] setup-gitlab-start[2190]: + echo nixbot-test-token-of-20-chars1478gitlab # [ 189.411494] setup-gitlab-start[2190]: + chmod 644 /var/lib/secrets/gitlab-token1479gitlab # [ 189.414910] setup-gitlab-start[2190]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1480gitlab # [ 189.587408] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:06:59:52 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1431481gitlab # [ 190.409635] gitaly[905]: time="2026-10-03T06:59:53.616Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:03.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.616" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1482gitlab # [ 190.410173] gitaly[905]: time="2026-10-03T06:59:53.617Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:03.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.616" grpc.time_ms=0.397 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1483gitlab # [ 190.523538] gitaly[905]: time="2026-10-03T06:59:53.731Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:03.120" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.730" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1484gitlab # [ 190.523819] gitaly[905]: time="2026-10-03T06:59:53.731Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:03.120" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.730" grpc.time_ms=0.367 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1485gitlab # [ 190.633388] gitaly[905]: time="2026-10-03T06:59:53.840Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R diskcache=164e76a6-2c89-4aa7-96d1-795dd50a8d10 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-03T07:00:03.175" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.786" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1486gitlab # [ 190.651224] gitaly[905]: time="2026-10-03T06:59:53.858Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:03.247" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.858" pid=905 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1487gitlab # [ 190.655059] gitaly[905]: time="2026-10-03T06:59:53.859Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:03.247" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.858" grpc.time_ms=0.799 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 190.668177] gitaly[905]: time="2026-10-03T06:59:53.875Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-03T07:00:03.255" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.866" grpc.time_ms=9.078 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 190.697090] gitaly[905]: time="2026-10-03T06:59:53.904Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1581 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-03T07:00:03.175" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.786" grpc.time_ms=55.145 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 190.725111] gitaly[905]: time="2026-10-03T06:59:53.932Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:03.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.932" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 190.726066] gitaly[905]: time="2026-10-03T06:59:53.932Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:03.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.932" grpc.time_ms=0.206 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1492gitlab # [ 190.786322] gitaly[905]: time="2026-10-03T06:59:53.993Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R diskcache=435d9296-3a96-4a93-858b-30adb8ff1018 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-03T07:00:03.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.953" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 190.787183] gitaly[905]: time="2026-10-03T06:59:53.994Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1568 command.oublock=32 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-03T07:00:03.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:53.953" grpc.time_ms=40.409 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 190.800465] gitaly[905]: time="2026-10-03T06:59:54.008Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:04.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:54.007" pid=905 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1495gitlab # [ 190.801300] gitaly[905]: time="2026-10-03T06:59:54.008Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:04.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:54.007" grpc.time_ms=0.663 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 190.843075] gitaly[905]: time="2026-10-03T06:59:54.050Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-03T07:00:04.039" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:54.039" grpc.time_ms=10.727 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 190.877592] gitaly[905]: time="2026-10-03T06:59:54.085Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:04.084" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:54.085" grpc.time_ms=0.113 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 190.888911] gitaly[905]: time="2026-10-03T06:59:54.096Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-03T07:00:04.095" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:54.095" grpc.time_ms=0.729 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1499gitlab # [ 191.312918] gitaly[905]: time="2026-10-03T06:59:54.520Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M408ZSB5TZHC1TFY8765ZG9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-03T07:00:04.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T06:59:54.510" grpc.time_ms=10.071 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1500gitlab # [ 191.682642] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:06:59:54 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 20831501gitlab # [ 191.687370] setup-gitlab-start[2472]: {"id":1,"message":null,"error":null}1502gitlab # [ 192.513177] sidekiq-cluster[2460]: {"severity":"INFO","time":"2026-10-03T06:59:55.703Z","message":"Starting cluster with 1 processes"}1503gitlab # [ 196.833374] gitaly[905]: time="2026-10-03T07:00:00.040Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M409009D4DQ6PAK16FSK49M9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-03T07:00:10.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:00.029" grpc.time_ms=10.887 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1504gitlab # [ 196.893940] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:00 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1831505gitlab # [ 196.899469] setup-gitlab-start[2190]: + mkdir -p /tmp/test-flake1506gitlab # [ 196.902687] setup-gitlab-start[2190]: + cd /tmp/test-flake1507gitlab # [ 196.902795] setup-gitlab-start[2190]: + git init -b master1508gitlab # [ 196.930124] setup-gitlab-start[2548]: Initialized empty Git repository in /tmp/test-flake/.git/1509gitlab # [ 196.932605] setup-gitlab-start[2190]: + git config user.name test1510gitlab # [ 196.934874] setup-gitlab-start[2190]: + git config user.email test@example.com1511gitlab # [ 196.937433] setup-gitlab-start[2190]: + cat1512gitlab # [ 196.939109] setup-gitlab-start[2190]: + git add flake.nix1513gitlab # [ 196.941112] setup-gitlab-start[2190]: + git commit -m 'initial commit'1514gitlab # [ 196.958624] setup-gitlab-start[2553]: [master (root-commit) 1136d72] initial commit1515gitlab # [ 196.958766] setup-gitlab-start[2553]: 1 file changed, 10 insertions(+)1516gitlab # [ 196.959929] setup-gitlab-start[2553]: create mode 100644 flake.nix1517gitlab # [ 196.965630] systemd[1]: Starting Logrotate Service...1518gitlab # [ 196.967747] setup-gitlab-start[2190]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1519gitlab # [ 196.974543] setup-gitlab-start[2190]: + git push -u origin master1520gitlab # [ 197.026450] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:00 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 271521gitlab # [ 197.032525] systemd[1]: logrotate.service: Deactivated successfully.1522gitlab # [ 197.033175] systemd[1]: Finished Logrotate Service.1523gitlab # [ 197.125162] gitaly[905]: time="2026-10-03T07:00:00.332Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M40900KMZK7YG4G2W9NRHRCB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:00.319" grpc.time_ms=13.064 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1524gitlab # [ 197.154089] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:00 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 901525gitlab # [ 197.525520] gitaly[905]: time="2026-10-03T07:00:00.733Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-03T07:00:10.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:00.726" grpc.time_ms=6.256 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1526gitlab # [ 197.564585] gitaly[905]: time="2026-10-03T07:00:00.772Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=6 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-03T07:00:30.054" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-03T07:00:00.755" grpc.time_ms=16.804 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1527gitlab # [ 197.591639] gitaly[905]: time="2026-10-03T07:00:00.792Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M40900QK9ARNFCNFPDWMY2DN duration_ms=132ns method=POST pid=905 status=200 url="http://unix/api/v4/internal/allowed"1528gitlab # [ 197.606434] gitaly[905]: time="2026-10-03T07:00:00.814Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M40900QK9ARNFCNFPDWMY2DN duration_ms=20ns method=POST pid=905 status=200 url="http://unix/api/v4/internal/pre_receive"1529gitlab # [ 197.611652] gitaly[905]: time="2026-10-03T07:00:00.814Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:00.659" grpc.time_ms=154.884 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1530gitlab # [ 197.657065] gitaly[905]: time="2026-10-03T07:00:00.864Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:00.863" grpc.time_ms=1.098 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1531gitlab # [ 197.696236] gitaly[905]: time="2026-10-03T07:00:00.903Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:00.903" grpc.time_ms=0.351 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1532gitlab # [ 197.723172] gitaly[905]: time="2026-10-03T07:00:00.930Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:00.930" grpc.time_ms=0.241 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1533gitlab # [ 197.828993] gitaly[905]: time="2026-10-03T07:00:01.036Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-03T07:00:11.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:01.030" grpc.time_ms=5.717 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 197.877697] gitaly[905]: time="2026-10-03T07:00:01.084Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1563 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-03T07:00:11.045" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:01.066" grpc.time_ms=18.174 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 197.885643] gitaly[905]: time="2026-10-03T07:00:01.093Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M40900QK9ARNFCNFPDWMY2DN duration_ms=135ns method=POST pid=905 status=200 url="http://unix/api/v4/internal/post_receive"1536gitlab # [ 197.886494] gitaly[905]: time="2026-10-03T07:00:01.094Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:00.957" grpc.time_ms=136.867 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1537gitlab # [ 197.913714] gitaly[905]: time="2026-10-03T07:00:01.121Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN diskcache=2a91964a-c85f-470e-bd9e-127d09a9ec59 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:00.584" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1538gitlab # [ 197.914053] gitaly[905]: time="2026-10-03T07:00:01.121Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=194 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13174 command.oublock=32 command.real_time_ms=527 command.spawn_token_fork_ms=0 command.system_time_ms=122 command.user_time_ms=72 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:00.584" grpc.time_ms=537.148 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1539gitlab # [ 197.915185] gitlab-workhorse[823]: time="2026-10-03T07:00:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521540gitlab # [ 197.915731] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:01 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7501541gitlab # [ 197.938931] setup-gitlab-start[2558]: To http://gitlab/root/test-flake.git1542gitlab # [ 197.939632] setup-gitlab-start[2558]: * [new branch] master -> master1543gitlab # [ 197.943986] setup-gitlab-start[2558]: branch 'master' set up to track 'origin/master'.1544gitlab # [ 197.948092] systemd[1]: Finished setup-gitlab.service.1545gitlab # [ 197.950099] systemd[1]: Starting nixbot CI service...1546gitlab: (finished: waiting for unit setup-gitlab.service, in 199.11 seconds)1547gitlab: waiting for unit nixbot.service1548gitlab # [ 199.277791] nixbot[2646]: {"ts": "2026-10-03T07:00:02.484Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1549gitlab # [ 199.314728] nixbot[2646]: {"ts": "2026-10-03T07:00:02.522Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1550gitlab # [ 199.332941] nixbot[2646]: {"ts": "2026-10-03T07:00:02.540Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1551gitlab # [ 199.342115] nixbot[2646]: {"ts": "2026-10-03T07:00:02.549Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1552gitlab # [ 199.347162] nixbot[2646]: {"ts": "2026-10-03T07:00:02.554Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1553gitlab # [ 199.352233] nixbot[2646]: {"ts": "2026-10-03T07:00:02.558Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1554gitlab # [ 199.353840] nixbot[2646]: {"ts": "2026-10-03T07:00:02.561Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1555gitlab # [ 199.355539] nixbot[2646]: {"ts": "2026-10-03T07:00:02.563Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1556gitlab # [ 199.366407] nixbot[2646]: {"ts": "2026-10-03T07:00:02.567Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1557gitlab # [ 199.371377] nixbot[2646]: {"ts": "2026-10-03T07:00:02.569Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1558gitlab # [ 199.376590] nixbot[2646]: {"ts": "2026-10-03T07:00:02.573Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1559gitlab # [ 199.381356] nixbot[2646]: {"ts": "2026-10-03T07:00:02.577Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1560gitlab # [ 199.385451] nixbot[2646]: {"ts": "2026-10-03T07:00:02.580Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1561gitlab # [ 199.389700] nixbot[2646]: {"ts": "2026-10-03T07:00:02.582Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1562gitlab # [ 199.394114] nixbot[2646]: {"ts": "2026-10-03T07:00:02.585Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1563gitlab # [ 199.398407] nixbot[2646]: {"ts": "2026-10-03T07:00:02.588Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1564gitlab # [ 199.401418] nixbot[2646]: {"ts": "2026-10-03T07:00:02.590Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1565gitlab # [ 199.403739] nixbot[2646]: {"ts": "2026-10-03T07:00:02.592Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1566gitlab # [ 199.405867] nixbot[2646]: {"ts": "2026-10-03T07:00:02.595Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1567gitlab # [ 199.408373] nixbot[2646]: {"ts": "2026-10-03T07:00:02.598Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1568gitlab # [ 199.410848] nixbot[2646]: {"ts": "2026-10-03T07:00:02.600Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1569gitlab # [ 199.411562] nixbot[2646]: {"ts": "2026-10-03T07:00:02.603Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1570gitlab # [ 199.412501] nixbot[2646]: {"ts": "2026-10-03T07:00:02.606Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1571gitlab # [ 199.413243] nixbot[2646]: {"ts": "2026-10-03T07:00:02.608Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1572gitlab # [ 199.414146] nixbot[2646]: {"ts": "2026-10-03T07:00:02.610Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1573gitlab # [ 199.414832] nixbot[2646]: {"ts": "2026-10-03T07:00:02.612Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1574gitlab # [ 199.415710] nixbot[2646]: {"ts": "2026-10-03T07:00:02.614Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1575gitlab # [ 199.416552] nixbot[2646]: {"ts": "2026-10-03T07:00:02.616Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1576gitlab # [ 199.417513] nixbot[2646]: {"ts": "2026-10-03T07:00:02.618Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1577gitlab # [ 199.418616] nixbot[2646]: {"ts": "2026-10-03T07:00:02.626Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1578gitlab # [ 199.422842] nixbot[2646]: {"ts": "2026-10-03T07:00:02.630Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1579gitlab # [ 199.424878] nixbot[2646]: {"ts": "2026-10-03T07:00:02.632Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1580gitlab # [ 199.427484] nixbot[2646]: {"ts": "2026-10-03T07:00:02.635Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1581gitlab # [ 199.431262] nixbot[2646]: {"ts": "2026-10-03T07:00:02.638Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1582gitlab # [ 199.433125] nixbot[2646]: {"ts": "2026-10-03T07:00:02.640Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1583gitlab # [ 199.441962] nixbot[2646]: {"ts": "2026-10-03T07:00:02.649Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1584gitlab # [ 199.447511] nixbot[2646]: {"ts": "2026-10-03T07:00:02.655Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1585gitlab # [ 199.827777] nixbot[2646]: INFO: Started server process [2646]1586gitlab # [ 199.828886] nixbot[2646]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1587gitlab # [ 199.847190] nixbot[2646]: INFO: ::ffff:127.0.0.1:53506 - "GET /health HTTP/1.1" 200 OK1588gitlab # [ 199.852288] systemd[1]: Started nixbot CI service.1589gitlab # [ 199.853853] systemd[1]: Reached target Multi-User System.1590gitlab # [ 199.854982] systemd[1]: Startup finished in 1.196s (kernel) + 3.607s (initrd) + 3min 15.050s (userspace) = 3min 19.854s.1591gitlab # [ 200.468051] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:03 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 6201592gitlab # [ 200.475243] nixbot[2646]: {"ts": "2026-10-03T07:00:03.682Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1593gitlab # [ 200.501406] nixbot[2646]: {"ts": "2026-10-03T07:00:03.708Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1594gitlab: (finished: waiting for unit nixbot.service, in 2.08 seconds)1595gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1596gitlab # [ 200.540834] nixbot[2646]: INFO: ::ffff:127.0.0.1:53522 - "GET /health HTTP/1.1" 200 OK1597gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1598subtest: project discovered and webhook registered1599gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1600gitlab # [ 200.584975] nixbot[2646]: {"ts": "2026-10-03T07:00:03.790Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1601gitlab # [ 200.590364] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 761602gitlab # [ 200.595212] nixbot[2646]: {"ts": "2026-10-03T07:00:03.802Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1603gitlab # [ 200.616844] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 471604gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1605gitlab # [ 200.725744] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 1281606gitlab # [ 200.730783] nixbot[2646]: {"ts": "2026-10-03T07:00:03.934Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1607gitlab # [ 200.852217] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1171608gitlab # [ 200.858772] nixbot[2646]: {"ts": "2026-10-03T07:00:04.066Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1609gitlab # [ 200.938985] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 631610gitlab # [ 200.944669] nixbot[2646]: {"ts": "2026-10-03T07:00:04.152Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1611gitlab # [ 200.999982] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 441612gitlab # [ 201.005722] nixbot[2646]: {"ts": "2026-10-03T07:00:04.213Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1613gitlab # [ 201.066837] gitaly[905]: time="2026-10-03T07:00:04.273Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M40904G1PDRR1PJRCC4B7997 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-03T07:00:34.056" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:04.257" grpc.time_ms=16.184 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 201.099734] gitaly[905]: time="2026-10-03T07:00:04.291Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40904G1PDRR1PJRCC4B7997 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:00:34.090" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:04.290" grpc.time_ms=0.57 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 201.120049] gitaly[905]: time="2026-10-03T07:00:04.304Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M40904G1PDRR1PJRCC4B7997 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-03T07:00:14.294" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:04.294" grpc.time_ms=9.25 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 201.135199] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1041617gitlab # [ 201.137676] nixbot[2646]: {"ts": "2026-10-03T07:00:04.340Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1618gitlab # [ 201.213404] nixbot[2646]: {"ts": "2026-10-03T07:00:04.420Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1619gitlab # [ 201.219746] nixbot[2646]: {"ts": "2026-10-03T07:00:04.424Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1620gitlab # [ 201.220460] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 791621gitlab # [ 201.365267] gitaly[905]: time="2026-10-03T07:00:04.572Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40904RS5R7HPAMVTCJ5TQ9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:04.566" grpc.time_ms=6.4 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1622gitlab # [ 201.367257] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 681623gitlab # [ 201.455662] gitaly[905]: time="2026-10-03T07:00:04.663Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M40904V1HE6YYHKBKFRK8CV6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:04.649" pid=905 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1624gitlab # [ 201.477806] gitaly[905]: time="2026-10-03T07:00:04.663Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40904V1HE6YYHKBKFRK8CV6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:04.649" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1625gitlab # [ 201.503105] gitlab-workhorse[823]: time="2026-10-03T07:00:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131626gitlab # [ 201.506348] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 861627gitlab # [ 201.508185] gitaly[905]: time="2026-10-03T07:00:04.663Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40904V1HE6YYHKBKFRK8CV6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:04.649" grpc.time_ms=13.569 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1628gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1629gitlab # [ 201.638728] gitaly[905]: time="2026-10-03T07:00:04.845Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M40904ZWRYHCBHSZFYSFSGQA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:04.821" pid=905 remote_ip="2001:db8:1::1" request_sha=740f5450bf95c8040d15a384ce2c0dd677c25b1a response_bytes=222 span.kind=server system=grpc1630gitlab # [ 201.661441] gitaly[905]: time="2026-10-03T07:00:04.846Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1190 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M40904ZWRYHCBHSZFYSFSGQA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:04.821" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1631gitlab # [ 201.684024] gitlab-workhorse[823]: time="2026-10-03T07:00:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2221632gitlab # [ 201.686351] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 222 "" "git/2.55.0" 1291633gitlab # [ 201.688295] gitaly[905]: time="2026-10-03T07:00:04.861Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1190 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M40904ZWRYHCBHSZFYSFSGQA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:04.821" grpc.time_ms=24.809 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1634gitlab # [ 201.728134] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 391635gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.11 seconds)1636(finished: subtest: project discovered and webhook registered, in 1.18 seconds)1637subtest: push delivers the webhook1638gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1639gitlab # [ 201.764370] gitaly[905]: time="2026-10-03T07:00:04.972Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4090569Y28HCMQXY7HHP6H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:04.965" grpc.time_ms=5.882 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1640gitlab # [ 201.777315] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 341641gitlab # [ 201.816863] gitaly[905]: time="2026-10-03T07:00:05.024Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M409057DJCA2QH90NR63MMBF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:05.017" pid=905 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1642gitlab # [ 201.818230] gitaly[905]: time="2026-10-03T07:00:05.024Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M409057DJCA2QH90NR63MMBF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:05.017" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1643gitlab # [ 201.844373] gitaly[905]: time="2026-10-03T07:00:05.052Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M409057DJCA2QH90NR63MMBF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:05.017" grpc.time_ms=34.661 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1644gitlab # [ 201.857957] gitlab-workhorse[823]: time="2026-10-03T07:00:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671645gitlab # [ 201.858600] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 921646gitlab # [ 201.943471] gitaly[905]: time="2026-10-03T07:00:05.151Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40905BJ1VS7DFB50TMAJ91Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:05.139" grpc.time_ms=11.598 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1647gitlab # [ 201.978370] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:05 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 791648gitlab # [ 202.029520] gitaly[905]: time="2026-10-03T07:00:05.237Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M40905E6G6WYXDX9HED024JQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:05.222" pid=905 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1649gitlab # [ 202.030299] gitaly[905]: time="2026-10-03T07:00:05.237Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M40905E6G6WYXDX9HED024JQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:05.222" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1650gitlab # [ 202.074815] gitaly[905]: time="2026-10-03T07:00:05.282Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M40905E6G6WYXDX9HED024JQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:05.222" grpc.time_ms=59.187 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1651gitlab # [ 202.076409] gitlab-workhorse[823]: time="2026-10-03T07:00:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091652gitlab # [ 202.077218] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 931653gitlab # [ 202.166961] gitaly[905]: time="2026-10-03T07:00:05.374Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:00:35.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:05.373" grpc.time_ms=0.853 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 202.232473] gitaly[905]: time="2026-10-03T07:00:05.439Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-03T07:00:35.129" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:05.429" grpc.time_ms=9.798 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 202.284287] gitaly[905]: time="2026-10-03T07:00:05.491Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:15.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:05.486" grpc.time_ms=5.64 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 202.315078] gitaly[905]: time="2026-10-03T07:00:05.522Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:15.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:05.517" grpc.time_ms=5.269 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 202.393538] gitaly[905]: time="2026-10-03T07:00:05.601Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-03T07:00:15.119" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:05.600" grpc.time_ms=0.421 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 202.437438] gitaly[905]: time="2026-10-03T07:00:05.645Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=615 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-03T07:00:15.153" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:05.633" grpc.time_ms=10.846 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 202.522161] gitaly[905]: time="2026-10-03T07:00:05.728Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:05.727" grpc.time_ms=1.046 pid=905 span.kind=server system=grpc1660gitlab # [ 202.581448] gitaly[905]: time="2026-10-03T07:00:05.789Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:05.788" grpc.time_ms=0.507 pid=905 span.kind=server system=grpc1661gitlab # [ 202.610525] gitaly[905]: time="2026-10-03T07:00:05.818Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG diskcache=bdd71542-74c7-4871-b11f-541a8338a99e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-03T07:00:15.194" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:05.674" pid=905 ref=refs/keep-around/1136d72de7cdb05e5647e7cc9474920fc4a06039 remote_ip="2001:db8:1::1" revision=1136d72de7cdb05e5647e7cc9474920fc4a06039 span.kind=server system=grpc username=root1662gitlab # [ 202.611300] gitaly[905]: time="2026-10-03T07:00:05.818Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=91 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4980 command.oublock=8 command.real_time_ms=133 command.spawn_token_fork_ms=2 command.system_time_ms=57 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-03T07:00:15.194" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:05.674" grpc.time_ms=143.391 pid=905 ref=refs/keep-around/1136d72de7cdb05e5647e7cc9474920fc4a06039 remote_ip="2001:db8:1::1" revision=1136d72de7cdb05e5647e7cc9474920fc4a06039 span.kind=server system=grpc username=root1663gitlab # [ 202.617461] gitaly[905]: time="2026-10-03T07:00:05.825Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:00:35.124" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:05.824" grpc.time_ms=0.556 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1664gitlab # [ 202.742602] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 6161665gitlab # [ 202.743920] nixbot[2646]: {"ts": "2026-10-03T07:00:05.950Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 \"HTTP/1.1 201 Created\""}1666gitlab # [ 202.766188] nixbot[2646]: {"ts": "2026-10-03T07:00:05.973Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-1136d72de7cd-0"}1667gitlab # [ 202.925875] nixbot[2646]: {"ts": "2026-10-03T07:00:06.133Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1136d72de7cd-0", "argv0": "bwrap"}1668gitlab # [ 203.032917] systemd[1]: Started Nix Daemon.1669gitlab # [ 203.091954] nix-daemon[2812]: accepted connection from pid 2807, user nixbot1670gitlab # [ 207.582919] nix-daemon[2812]: accepted connection from pid 2854, user nixbot1671gitlab # [ 207.597840] nix-daemon[2812]: accepted connection from pid 2807, user nixbot1672gitlab # [ 212.007172] nix-daemon[2812]: accepted connection from pid 2807, user nixbot1673gitlab # [ 212.106449] nix-daemon[2812]: accepted connection from pid 2897, user nixbot1674gitlab # [ 212.144648] gitaly[905]: time="2026-10-03T07:00:15.352Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4090FA5WP5NBJH709TRBT5M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:00:45.150" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:15.351" grpc.time_ms=0.628 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675gitlab # [ 212.202323] gitaly[905]: time="2026-10-03T07:00:15.410Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4090FA5WP5NBJH709TRBT5M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:25.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:15.404" grpc.time_ms=5.418 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 212.278144] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1831677gitlab # [ 212.285767] nixbot[2646]: {"ts": "2026-10-03T07:00:15.493Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 \"HTTP/1.1 201 Created\""}1678gitlab # [ 212.334856] gitaly[905]: time="2026-10-03T07:00:15.542Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4090FGJC15NBB49KSVE2TRF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:00:45.240" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:15.541" grpc.time_ms=0.814 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679gitlab # [ 212.372467] gitaly[905]: time="2026-10-03T07:00:15.580Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4090FGJC15NBB49KSVE2TRF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:25.090" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:15.571" grpc.time_ms=8.679 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680gitlab # [ 212.407299] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1061681gitlab # [ 212.407473] nixbot[2646]: {"ts": "2026-10-03T07:00:15.613Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 \"HTTP/1.1 201 Created\""}1682gitlab # [ 217.020458] nix-daemon[2812]: accepted connection from pid 2971, user nixbot1683gitlab # [ 217.106807] gitaly[905]: time="2026-10-03T07:00:20.313Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4090M507AMPYHQX98N6KV6D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:00:50.012" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:20.312" grpc.time_ms=0.848 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1684gitlab # [ 217.134870] gitaly[905]: time="2026-10-03T07:00:20.342Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4090M507AMPYHQX98N6KV6D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:30.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:20.331" grpc.time_ms=10.82 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685gitlab # [ 217.194801] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1421686gitlab # [ 217.196182] nixbot[2646]: {"ts": "2026-10-03T07:00:20.399Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 \"HTTP/1.1 201 Created\""}1687gitlab # [ 217.465047] sidekiq-cluster[2520]: 2026-10-03T07:00:20.672Z pid=2520 tid=xv4 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2520, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>436920320}1688gitlab # [ 217.586084] gitaly[905]: time="2026-10-03T07:00:20.792Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4090MHEMW63FVBR4HQAZV7F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:20.786" grpc.time_ms=6.388 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1689gitlab # [ 217.587204] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1391690gitlab # [ 217.656908] sidekiq-cluster[2520]: W, [2026-10-03T07:00:20.864532 #2520] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1691gitlab # [ 217.693638] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:20.901Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1692gitlab # [ 217.730392] gitaly[905]: time="2026-10-03T07:00:20.937Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4090MNW3DFCSFGXQGNYX69D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:20.924" pid=905 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1693gitlab # [ 217.730841] gitaly[905]: time="2026-10-03T07:00:20.938Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4090MNW3DFCSFGXQGNYX69D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:20.924" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1694gitlab # [ 217.732324] gitlab-workhorse[823]: time="2026-10-03T07:00:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671695gitlab # [ 217.733994] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1421696gitlab # [ 217.739395] gitaly[905]: time="2026-10-03T07:00:20.938Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4090MNW3DFCSFGXQGNYX69D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:20.924" grpc.time_ms=13.515 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1697gitlab # [ 217.801693] gitaly[905]: time="2026-10-03T07:00:21.009Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4090MV5P1E7PGAF8TZCNV85 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:21.001" grpc.time_ms=7.299 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1698gitlab # [ 217.802352] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:21 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 431699gitlab # [ 217.850060] gitaly[905]: time="2026-10-03T07:00:21.057Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4090MWK6ARRNDXN3YWZ5STD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:21.051" pid=905 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1700gitlab # [ 217.850530] gitaly[905]: time="2026-10-03T07:00:21.058Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4090MWK6ARRNDXN3YWZ5STD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:21.051" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1701gitlab # [ 217.851531] gitlab-workhorse[823]: time="2026-10-03T07:00:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671702gitlab # [ 217.851940] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 471703gitlab # [ 217.852771] gitaly[905]: time="2026-10-03T07:00:21.058Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4090MWK6ARRNDXN3YWZ5STD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:21.051" grpc.time_ms=6.904 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1704gitlab # [ 219.404971] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:22.612Z","message":"GitLab reliable fetch activated!"}1705gitlab # [ 219.405434] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:22.612Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1706gitlab # [ 238.636501] postgres[3192]: [3192] ERROR: relation "table_without_models" does not exist1707gitlab # [ 238.636867] postgres[3192]: [3192] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1708gitlab # [ 241.025800] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:44.233Z","message":"Booted Rails 7.2.3.1 application in production environment"}1709gitlab # [ 241.030748] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:44.238Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1710gitlab # [ 241.035134] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:44.238Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1711gitlab # [ 241.039220] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:44.243Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1712gitlab # [ 241.045910] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:44.253Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1713gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 39.43 seconds)1714gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1715gitlab # [ 241.261260] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 421716gitlab # [ 241.355569] gitaly[905]: time="2026-10-03T07:00:44.562Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4091BSPBCQRZ3ZTZ102B7B3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:44.550" grpc.time_ms=12.08 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1717gitlab # [ 241.356376] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 921718gitlab # Enumerating objects: 5, done.1719gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1720gitlab # Delta compression using up to 4 threads1721gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1722gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1723gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1724gitlab # [ 241.561296] gitaly[905]: time="2026-10-03T07:00:44.768Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-03T07:01:14.059" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-03T07:00:44.760" grpc.time_ms=8.258 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725gitlab # [ 241.603179] gitaly[905]: time="2026-10-03T07:00:44.810Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M4091BXASDVK7BYXVHN7KDGJ duration_ms=92ns method=POST pid=905 status=200 url="http://unix/api/v4/internal/allowed"1726gitlab # [ 241.637467] gitaly[905]: time="2026-10-03T07:00:44.845Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M4091BXASDVK7BYXVHN7KDGJ duration_ms=33ns method=POST pid=905 status=200 url="http://unix/api/v4/internal/pre_receive"1727gitlab # [ 241.644061] gitaly[905]: time="2026-10-03T07:00:44.851Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:44.717" grpc.time_ms=134.434 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1728gitlab # [ 241.693538] gitaly[905]: time="2026-10-03T07:00:44.901Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:44.900" grpc.time_ms=0.649 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729gitlab # [ 241.739800] gitaly[905]: time="2026-10-03T07:00:44.947Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:44.947" grpc.time_ms=0.376 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730gitlab # [ 241.770116] gitaly[905]: time="2026-10-03T07:00:44.977Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:44.977" grpc.time_ms=0.248 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1731gitlab # [ 241.841350] gitaly[905]: time="2026-10-03T07:00:45.049Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M4091BXASDVK7BYXVHN7KDGJ duration_ms=40ns method=POST pid=905 status=200 url="http://unix/api/v4/internal/post_receive"1732gitlab # [ 241.847751] gitaly[905]: time="2026-10-03T07:00:45.055Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:45.008" grpc.time_ms=47.336 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1733gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.72 seconds)1734gitlab # [ 241.875682] gitaly[905]: time="2026-10-03T07:00:45.083Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ diskcache=b5cfe892-9428-47e0-81a8-ef89c2b698d9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:44.638" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1735gitlab: must succeed: git -C /tmp/test-flake rev-parse master1736gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1737gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe'1738gitlab # [ 241.876065] gitaly[905]: time="2026-10-03T07:00:45.083Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=188 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=880640 command.minflt=13688 command.oublock=32 command.real_time_ms=436 command.spawn_token_fork_ms=0 command.system_time_ms=124 command.user_time_ms=64 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:44.638" grpc.time_ms=444.938 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1739gitlab # [ 241.876722] gitlab-workhorse[823]: time="2026-10-03T07:00:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521740gitlab # [ 241.877184] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:45 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4981741gitlab # To http://gitlab/root/test-flake.git1742gitlab # 1136d72..f4cbbac master -> master1743gitlab # [ 241.968961] nixbot[2646]: INFO: ::ffff:127.0.0.1:36114 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 200 OK1744gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe', in 0.08 seconds)1745gitlab # [ 242.463962] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:45.670Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bd99e98975c8c7ae4f7bb566","created_at":"2026-10-03T06:59:53.889Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:53.914Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bd99e98975c8c7ae4f7bb566: start","job_status":"start","queue_duration_s":51.75598,"scheduling_latency_s":51.756019}1746gitlab # [ 242.696760] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:45.903Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bd99e98975c8c7ae4f7bb566","created_at":"2026-10-03T06:59:53.889Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:53.914Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bd99e98975c8c7ae4f7bb566: done: 0.233072 sec","job_status":"done","queue_duration_s":51.75598,"scheduling_latency_s":51.756019,"redis_calls":25,"redis_duration_s":0.008411,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004867,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002137,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001407,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.102872851,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.233072,"completed_at":"2026-10-03T07:00:45.903Z","load_balancing_strategy":"primary","db_duration_s":0.063728,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1747gitlab # [ 242.698638] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:45.906Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f44c1f406af56641f2b8633a","created_at":"2026-10-03T06:59:53.924Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:53.928Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f44c1f406af56641f2b8633a: start","job_status":"start","queue_duration_s":51.977388,"scheduling_latency_s":51.977426}1748gitlab # [ 242.787505] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:45.994Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f44c1f406af56641f2b8633a","created_at":"2026-10-03T06:59:53.924Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:53.928Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f44c1f406af56641f2b8633a: done: 0.088801 sec","job_status":"done","queue_duration_s":51.977388,"scheduling_latency_s":51.977426,"redis_calls":14,"redis_duration_s":0.003688,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000897,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001589,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.067374485,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.088801,"completed_at":"2026-10-03T07:00:45.994Z","load_balancing_strategy":"primary","db_duration_s":0.024425,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1749gitlab # [ 242.788830] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:45.996Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"a46223d3837f14816ba1800d","created_at":"2026-10-03T06:59:54.412Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:54.417Z","job_size_bytes":5,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-a46223d3837f14816ba1800d: start","job_status":"start","queue_duration_s":51.578975,"scheduling_latency_s":51.578988}1750gitlab # [ 242.904304] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:46.111Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"a46223d3837f14816ba1800d","created_at":"2026-10-03T06:59:54.412Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:54.417Z","job_size_bytes":5,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-a46223d3837f14816ba1800d: done: 0.115378 sec","job_status":"done","queue_duration_s":51.578975,"scheduling_latency_s":51.578988,"redis_calls":12,"redis_duration_s":0.0027719999999999997,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000694,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001599,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000320712,"duration_s":0.115378,"completed_at":"2026-10-03T07:00:46.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025408,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1751gitlab # [ 242.908664] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:46.116Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"ec4bcac7d8f4e7d97a5ae3cf","created_at":"2026-10-03T06:59:54.438Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:54.441Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-ec4bcac7d8f4e7d97a5ae3cf: start","job_status":"start","queue_duration_s":51.674737,"scheduling_latency_s":51.674753}1752gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe'1753gitlab # [ 243.001838] nixbot[2646]: INFO: ::ffff:127.0.0.1:33138 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 200 OK1754gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe', in 0.03 seconds)1755gitlab # [ 243.092522] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:46.299Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"ec4bcac7d8f4e7d97a5ae3cf","created_at":"2026-10-03T06:59:54.438Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:54.441Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-ec4bcac7d8f4e7d97a5ae3cf: done: 0.183517 sec","job_status":"done","queue_duration_s":51.674737,"scheduling_latency_s":51.674753,"redis_calls":11,"redis_duration_s":0.002495,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000643,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.158,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.158,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000298921,"duration_s":0.183517,"completed_at":"2026-10-03T07:00:46.299Z","load_balancing_strategy":"primary","db_duration_s":0.07764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1756gitlab # [ 243.164408] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:46.371Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"61acc5a1e42fec269af7bf66","created_at":"2026-10-03T06:59:54.443Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:54.446Z","job_size_bytes":89,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-61acc5a1e42fec269af7bf66: start","job_status":"start","queue_duration_s":51.924783,"scheduling_latency_s":51.924832}1757gitlab # [ 243.220289] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:46.427Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"61acc5a1e42fec269af7bf66","created_at":"2026-10-03T06:59:54.443Z","trace_propagation_headers":{"sentry-trace":"d2a2b459427348b8b152e770e3854ae0-e1fcd4c83d4940be","baggage":"sentry-trace_id=d2a2b459427348b8b152e770e3854ae0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M408ZSB5TZHC1TFY8765ZG9R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-03T06:59:54.446Z","job_size_bytes":89,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-61acc5a1e42fec269af7bf66: done: 0.056074 sec","job_status":"done","queue_duration_s":51.924783,"scheduling_latency_s":51.924832,"redis_calls":11,"redis_duration_s":0.003815,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00105,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001971,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000684165,"duration_s":0.056074,"completed_at":"2026-10-03T07:00:46.427Z","load_balancing_strategy":"primary","db_duration_s":0.006775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1758gitlab # [ 243.274910] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:46.482Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1136d72de7cdb05e5647e7cc9474920fc4a06039 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"30afcb71dccbf81aaa91bcf1","created_at":"2026-10-03T07:00:00.982Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-3a1895f147fd4951","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-03T07:00:01.001Z","job_size_bytes":185,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-30afcb71dccbf81aaa91bcf1: start","job_status":"start","queue_duration_s":45.480868,"scheduling_latency_s":45.480916}1759gitlab # [ 243.300688] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:46.508Z","message":"changes: \"0000000000000000000000000000000000000000 1136d72de7cdb05e5647e7cc9474920fc4a06039 refs/heads/master\\n\""}1760gitlab # [ 243.352104] gitaly[905]: time="2026-10-03T07:00:46.559Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:56.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:46.550" grpc.time_ms=8.861 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 243.364794] gitaly[905]: time="2026-10-03T07:00:46.572Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-03T07:00:56.023" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:46.564" grpc.time_ms=8.073 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 243.462961] gitaly[905]: time="2026-10-03T07:00:46.670Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-03T07:00:56.117" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:46.657" grpc.time_ms=12.646 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 243.510031] gitaly[905]: time="2026-10-03T07:00:46.717Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:46.717" grpc.time_ms=0.513 pid=905 span.kind=server system=grpc1764gitlab # [ 243.560165] gitaly[905]: time="2026-10-03T07:00:46.767Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:46.767" grpc.time_ms=0.662 pid=905 span.kind=server system=grpc1765gitlab # [ 243.581658] gitaly[905]: time="2026-10-03T07:00:46.789Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN diskcache=5a8a1b12-f2e9-4d2f-886b-3d0328321b40 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-03T07:00:56.140" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:46.681" pid=905 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1766gitlab # [ 243.582225] gitaly[905]: time="2026-10-03T07:00:46.789Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=87 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5201 command.oublock=8 command.real_time_ms=100 command.spawn_token_fork_ms=0 command.system_time_ms=49 command.user_time_ms=38 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-03T07:00:56.140" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:46.681" grpc.time_ms=108.429 pid=905 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1767gitlab # [ 243.602193] gitaly[905]: time="2026-10-03T07:00:46.809Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-03T07:00:56.269" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:46.809" grpc.time_ms=0.119 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 243.620311] gitaly[905]: time="2026-10-03T07:00:46.828Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=940 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-03T07:00:56.274" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:46.814" grpc.time_ms=13.366 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 243.718934] gitaly[905]: time="2026-10-03T07:00:46.926Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-03T07:01:16.017" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:46.918" grpc.time_ms=8.125 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 243.788273] gitaly[905]: time="2026-10-03T07:00:46.995Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-03T07:00:56.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:46.995" grpc.time_ms=0.354 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 243.821496] gitaly[905]: time="2026-10-03T07:00:47.029Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-03T07:00:57.001" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-03T07:00:47.021" grpc.time_ms=7.498 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 243.849358] gitaly[905]: time="2026-10-03T07:00:47.057Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:57.025" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:47.046" grpc.time_ms=10.899 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 243.866555] gitaly[905]: time="2026-10-03T07:00:47.074Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:57.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:47.063" grpc.time_ms=10.298 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 243.894835] gitaly[905]: time="2026-10-03T07:00:47.102Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-03T07:01:17.085" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:47.086" grpc.time_ms=16.347 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe'1776gitlab # [ 244.043494] nixbot[2646]: INFO: ::ffff:127.0.0.1:33148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 200 OK1777gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe', in 0.04 seconds)1778gitlab # [ 244.248603] gitaly[905]: time="2026-10-03T07:00:47.456Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-03T07:00:57.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:47.454" grpc.time_ms=1.398 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1779gitlab # [ 244.323240] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:47.529Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1136d72de7cdb05e5647e7cc9474920fc4a06039 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"30afcb71dccbf81aaa91bcf1","created_at":"2026-10-03T07:00:00.982Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-3a1895f147fd4951","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-03T07:00:01.001Z","job_size_bytes":185,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-30afcb71dccbf81aaa91bcf1: done: 1.047733 sec","job_status":"done","queue_duration_s":45.480868,"scheduling_latency_s":45.480916,"gitaly_calls":13,"gitaly_duration_s":0.348015,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.049741,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.00466,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.007214,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.00174,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004753,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.019225,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.012149,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.179,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.2,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.557531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000982806,"exclusive_lock_hold_duration_s":0.035510938000000006,"duration_s":1.047733,"completed_at":"2026-10-03T07:00:47.529Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.129357,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1780gitlab # [ 244.337254] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:47.532Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7f5d3fb99820ac8002878842","created_at":"2026-10-03T07:00:05.838Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-07555ab6d0c14405","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:05.845Z","job_size_bytes":65,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7f5d3fb99820ac8002878842: start","job_status":"start","queue_duration_s":41.68651,"scheduling_latency_s":41.686555}1781gitlab # [ 244.403844] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:47.611Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7f5d3fb99820ac8002878842","created_at":"2026-10-03T07:00:05.838Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-07555ab6d0c14405","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:05.845Z","job_size_bytes":65,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7f5d3fb99820ac8002878842: done: 0.079204 sec","job_status":"done","queue_duration_s":41.68651,"scheduling_latency_s":41.686555,"redis_calls":16,"redis_duration_s":0.004207,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002186,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001523,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000326857,"duration_s":0.079204,"completed_at":"2026-10-03T07:00:47.611Z","load_balancing_strategy":"primary","db_duration_s":0.021488,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1782gitlab # [ 244.410467] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:47.612Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a92a58e3a1926bbf598a494c","created_at":"2026-10-03T07:00:05.846Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-07555ab6d0c14405","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:05.851Z","job_size_bytes":65,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a92a58e3a1926bbf598a494c: start","job_status":"start","queue_duration_s":41.761262,"scheduling_latency_s":41.761276}1783gitlab # [ 244.489783] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:47.696Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a92a58e3a1926bbf598a494c","created_at":"2026-10-03T07:00:05.846Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-07555ab6d0c14405","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:05.851Z","job_size_bytes":65,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a92a58e3a1926bbf598a494c: done: 0.084009 sec","job_status":"done","queue_duration_s":41.761262,"scheduling_latency_s":41.761276,"redis_calls":21,"redis_duration_s":0.004896,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002101,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001498,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001297,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000411784,"duration_s":0.084009,"completed_at":"2026-10-03T07:00:47.696Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1784gitlab # [ 244.511826] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:47.699Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"73d2f59613b264d70db362e5","created_at":"2026-10-03T07:00:05.933Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-07555ab6d0c14405","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:05.937Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-73d2f59613b264d70db362e5: start","job_status":"start","queue_duration_s":41.761436,"scheduling_latency_s":41.761462}1785gitlab # [ 244.718836] gitaly[905]: time="2026-10-03T07:00:47.925Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:47.925" grpc.time_ms=0.532 pid=905 span.kind=server system=grpc1786gitlab # [ 244.767384] gitaly[905]: time="2026-10-03T07:00:47.974Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:47.974" grpc.time_ms=0.319 pid=905 span.kind=server system=grpc1787gitlab # [ 244.821309] gitaly[905]: time="2026-10-03T07:00:48.029Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:48.028" grpc.time_ms=0.296 pid=905 span.kind=server system=grpc1788gitlab # [ 244.846559] gitaly[905]: time="2026-10-03T07:00:48.054Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG diskcache=a8a97d3d-40b4-4ad6-bf61-7799b3858bf9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:17.887" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:47.888" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 244.847348] gitaly[905]: time="2026-10-03T07:00:48.054Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=152 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7112 command.oublock=0 command.real_time_ms=158 command.spawn_token_fork_ms=0 command.system_time_ms=90 command.user_time_ms=62 component=gitaly.UnaryServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:17.887" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:47.888" grpc.time_ms=166.06 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 244.983552] gitaly[905]: time="2026-10-03T07:00:48.191Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-03T07:01:18.189" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:48.189" grpc.time_ms=1.369 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe'1792gitlab # [ 245.033814] gitaly[905]: time="2026-10-03T07:00:48.241Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40905JM8EHVAV6T2EYPJ3DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:18.239" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:48.240" grpc.time_ms=1.05 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 245.051130] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.257Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"73d2f59613b264d70db362e5","created_at":"2026-10-03T07:00:05.933Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-07555ab6d0c14405","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:05.937Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2520,"job_status":"rescheduled","message":"PipelineProcessWorker JID-73d2f59613b264d70db362e5: rescheduled"}1794gitlab # [ 245.064608] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.271Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"73d2f59613b264d70db362e5","created_at":"2026-10-03T07:00:05.933Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-07555ab6d0c14405","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:05.937Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-73d2f59613b264d70db362e5: done: 0.572153 sec","job_status":"done","queue_duration_s":41.761436,"scheduling_latency_s":41.761462,"gitaly_calls":3,"gitaly_duration_s":0.177368,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.032386,"redis_read_bytes":460,"redis_write_bytes":29289,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00111,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001747,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011908,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.00512,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15576,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.00712,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000647,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00075,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002874,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.290674,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.500371137,"duration_s":0.572153,"completed_at":"2026-10-03T07:00:48.271Z","load_balancing_strategy":"primary","db_duration_s":0.081434,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1795gitlab # [ 245.121778] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.278Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1136d72de7cdb05e5647e7cc9474920fc4a06039 f4cbbac2e60157e60cc76ced6ffe55e6880510fe refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"378e95e9cdd029a49fce1c8a","created_at":"2026-10-03T07:00:45.030Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-7ab7f14f8fd44253","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-03T07:00:45.031Z","job_size_bytes":185,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-378e95e9cdd029a49fce1c8a: start","job_status":"start","queue_duration_s":3.247233,"scheduling_latency_s":3.247269}1796gitlab # [ 245.122768] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.296Z","message":"changes: \"1136d72de7cdb05e5647e7cc9474920fc4a06039 f4cbbac2e60157e60cc76ced6ffe55e6880510fe refs/heads/master\\n\""}1797gitlab # [ 245.153580] gitaly[905]: time="2026-10-03T07:00:48.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=10 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:58.320" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:48.340" grpc.time_ms=20.704 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe', in 0.12 seconds)1799gitlab # [ 245.162986] nixbot[2646]: INFO: ::ffff:127.0.0.1:33152 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 200 OK1800gitlab # [ 245.176603] gitaly[905]: time="2026-10-03T07:00:48.384Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-03T07:00:58.015" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:48.375" grpc.time_ms=8.417 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 245.192716] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.400Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"e2cbb1101dab9af74887c002","created_at":"2026-10-03T07:00:48.397Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-dede452721cc4a62","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"ee6b68a8036e040434e70397","job_size_bytes":46,"pid":2520,"job_status":"deduplicated","message":"ProjectCacheWorker JID-e2cbb1101dab9af74887c002: deduplicated: until executing","deduplication.type":"until executing"}1802gitlab # [ 245.224637] gitaly[905]: time="2026-10-03T07:00:48.432Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-03T07:00:58.060" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:48.421" grpc.time_ms=10.638 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 245.252462] gitaly[905]: time="2026-10-03T07:00:48.460Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=658 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-03T07:01:18.448" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:48.449" grpc.time_ms=10.588 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 245.270508] gitaly[905]: time="2026-10-03T07:00:48.478Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-03T07:00:58.021" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-03T07:00:48.471" grpc.time_ms=6.521 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 245.294241] gitaly[905]: time="2026-10-03T07:00:48.501Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:58.041" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:48.491" grpc.time_ms=10.223 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 245.416334] gitaly[905]: time="2026-10-03T07:00:48.623Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-03T07:00:58.172" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:48.622" grpc.time_ms=1.142 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 245.435689] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.642Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1136d72de7cdb05e5647e7cc9474920fc4a06039 f4cbbac2e60157e60cc76ced6ffe55e6880510fe refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"378e95e9cdd029a49fce1c8a","created_at":"2026-10-03T07:00:45.030Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-7ab7f14f8fd44253","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-03T07:00:45.031Z","job_size_bytes":185,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-378e95e9cdd029a49fce1c8a: done: 0.363857 sec","job_status":"done","queue_duration_s":3.247233,"scheduling_latency_s":3.247269,"gitaly_calls":7,"gitaly_duration_s":0.127377,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.048453,"redis_read_bytes":501,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.003138,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001133,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.01125,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.022516,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.010416,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.028,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.028,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.16651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00076993,"exclusive_lock_hold_duration_s":0.056387055,"duration_s":0.363857,"completed_at":"2026-10-03T07:00:48.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028369,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1808gitlab # [ 245.454649] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.644Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ee6b68a8036e040434e70397","created_at":"2026-10-03T07:00:46.598Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:46.622Z","job_size_bytes":46,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ee6b68a8036e040434e70397: start","job_status":"start","queue_duration_s":2.021772,"scheduling_latency_s":2.021789}1809gitlab # [ 245.536847] gitaly[905]: time="2026-10-03T07:00:48.744Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-03T13:00:48.738" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:48.739" grpc.time_ms=4.691 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 245.567505] gitaly[905]: time="2026-10-03T07:00:48.775Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-03T07:01:18.765" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:48.766" grpc.time_ms=8.984 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 245.594979] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.802Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ee6b68a8036e040434e70397","created_at":"2026-10-03T07:00:46.598Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:46.622Z","job_size_bytes":46,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ee6b68a8036e040434e70397: done: 0.157884 sec","job_status":"done","queue_duration_s":2.021772,"scheduling_latency_s":2.021789,"gitaly_calls":2,"gitaly_duration_s":0.02803,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007444,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001414,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000532,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001847,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002826,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000825,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000862679,"duration_s":0.157884,"completed_at":"2026-10-03T07:00:48.801Z","load_balancing_strategy":"primary","db_duration_s":0.012438,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1812gitlab # [ 245.616848] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.804Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a85b23d3a0e32732f7865250","created_at":"2026-10-03T07:00:46.644Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:46.651Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a85b23d3a0e32732f7865250: start","job_status":"start","queue_duration_s":2.152767,"scheduling_latency_s":2.152798}1813gitlab # [ 245.658808] gitaly[905]: time="2026-10-03T07:00:48.866Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN diskcache=cee0c600-79e6-4cca-9d2b-9656af41025e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-03T13:00:48.835" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:48.836" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 245.659700] gitaly[905]: time="2026-10-03T07:00:48.866Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1281 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-03T13:00:48.835" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:48.836" grpc.time_ms=30.378 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 245.703710] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.910Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a85b23d3a0e32732f7865250","created_at":"2026-10-03T07:00:46.644Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:46.651Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a85b23d3a0e32732f7865250: done: 0.106384 sec","job_status":"done","queue_duration_s":2.152767,"scheduling_latency_s":2.152798,"gitaly_calls":1,"gitaly_duration_s":0.033707,"redis_calls":15,"redis_duration_s":0.004732,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000629,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000843,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001599,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.022,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07525565399999999,"duration_s":0.106384,"completed_at":"2026-10-03T07:00:48.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1816gitlab # [ 245.706191] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.912Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"cbaea85dd381d17ba97fcfa0","created_at":"2026-10-03T07:00:46.804Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:46.806Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-cbaea85dd381d17ba97fcfa0: start","job_status":"start","queue_duration_s":2.105931,"scheduling_latency_s":2.105946}1817gitlab # [ 245.736307] gitaly[905]: time="2026-10-03T07:00:48.943Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-03T07:01:18.031" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:48.932" grpc.time_ms=10.643 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 245.742476] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.949Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"cbaea85dd381d17ba97fcfa0","created_at":"2026-10-03T07:00:46.804Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:46.806Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-cbaea85dd381d17ba97fcfa0: done: 0.037495 sec","job_status":"done","queue_duration_s":2.105931,"scheduling_latency_s":2.105946,"gitaly_calls":1,"gitaly_duration_s":0.012619,"redis_calls":16,"redis_duration_s":0.003691,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000273,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001564,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000828,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037495,"completed_at":"2026-10-03T07:00:48.949Z","load_balancing_strategy":"primary","db_duration_s":0.003005,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1819gitlab # [ 245.776662] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:48.951Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"738b59678ea52423b61a9bcc","created_at":"2026-10-03T07:00:47.338Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4d4cfea63550252f93569c0dc831b361b92c1dbb671671bd77500728a6579b1c","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:47.342Z","job_size_bytes":467,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-738b59678ea52423b61a9bcc: start","job_status":"start","queue_duration_s":1.609012,"scheduling_latency_s":1.609029}1820gitlab # [ 245.819818] gitaly[905]: time="2026-10-03T07:00:48.970Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:18.068" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:48.969" grpc.time_ms=1.083 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 245.820621] gitaly[905]: time="2026-10-03T07:00:48.979Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-03T07:00:58.001" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:48.972" grpc.time_ms=7.478 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 245.860303] gitaly[905]: time="2026-10-03T07:00:49.068Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-03T07:01:19.067" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:49.067" grpc.time_ms=0.661 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 245.863979] gitaly[905]: time="2026-10-03T07:00:49.071Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=24 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-03T07:01:19.070" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:49.070" grpc.time_ms=1.445 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 245.921266] gitaly[905]: time="2026-10-03T07:00:49.128Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:00:59.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:49.123" grpc.time_ms=5.689 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe'1826gitlab # [ 246.210258] nixbot[2646]: INFO: ::ffff:127.0.0.1:33164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 200 OK1827gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe', in 0.05 seconds)1828gitlab # [ 246.358755] gitaly[905]: time="2026-10-03T07:00:49.566Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-03T07:01:19.548" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:49.549" grpc.time_ms=17.247 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab # [ 246.408467] gitaly[905]: time="2026-10-03T07:00:49.615Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M40900QK9ARNFCNFPDWMY2DN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-03T07:01:19.601" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:49.601" grpc.time_ms=14 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1830gitlab # [ 246.434517] sidekiq-cluster[2520]: {"severity":"WARN","time":"2026-10-03T07:00:49.636Z","class":"CreatePipelineWorker","correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"1136d72de7cdb05e5647e7cc9474920fc4a06039","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1136d72de7cdb05e5647e7cc9474920fc4a06039","ref":"refs/heads/master"},"retry":0}1831gitlab # [ 246.435769] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.641Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"738b59678ea52423b61a9bcc","created_at":"2026-10-03T07:00:47.338Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4d4cfea63550252f93569c0dc831b361b92c1dbb671671bd77500728a6579b1c","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:47.342Z","job_size_bytes":467,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-738b59678ea52423b61a9bcc: done: 0.690399 sec","job_status":"done","queue_duration_s":1.609012,"scheduling_latency_s":1.609029,"gitaly_calls":7,"gitaly_duration_s":0.092882,"redis_calls":51,"redis_duration_s":0.00872,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000828,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003757,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002108,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.546288,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028579,"duration_s":0.690399,"completed_at":"2026-10-03T07:00:49.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039474,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1832gitlab # [ 246.451534] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.643Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a34bb806-b3d9-481c-a870-3126d248dc4e\"}"],"class":"WebHookWorker","jid":"b9ce00ec70a4a5d8ce7a5786","created_at":"2026-10-03T07:00:47.430Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cf2bcf22d3dfd581e8f1fb34cf4a87ab58a6251a24ea82ef12dd1b14f4fbc747","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:47.434Z","job_size_bytes":1751,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b9ce00ec70a4a5d8ce7a5786: start","job_status":"start","queue_duration_s":2.208046,"scheduling_latency_s":2.208061}1833gitlab # [ 246.548956] nixbot[2646]: INFO: ::ffff:127.0.0.1:33174 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1834gitlab # [ 246.571823] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.778Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a34bb806-b3d9-481c-a870-3126d248dc4e\"}"],"class":"WebHookWorker","jid":"b9ce00ec70a4a5d8ce7a5786","created_at":"2026-10-03T07:00:47.430Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-1ce61b1597044d72","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cf2bcf22d3dfd581e8f1fb34cf4a87ab58a6251a24ea82ef12dd1b14f4fbc747","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:47.434Z","job_size_bytes":1751,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b9ce00ec70a4a5d8ce7a5786: done: 0.13541 sec","job_status":"done","queue_duration_s":2.208046,"scheduling_latency_s":2.208061,"redis_calls":19,"redis_duration_s":0.004528,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000935,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000531,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002044,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05850157000000422,"cpu_s":0.062055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001188699,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.13541,"completed_at":"2026-10-03T07:00:49.778Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1835gitlab # [ 246.628963] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.836Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8fedef3ff623b8f1c7fe265f","created_at":"2026-10-03T07:00:47.876Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:47.879Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8fedef3ff623b8f1c7fe265f: start","job_status":"start","queue_duration_s":1.956427,"scheduling_latency_s":1.956467}1836gitlab # [ 246.643259] gitaly[905]: time="2026-10-03T07:00:49.850Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4091GZPT4M13XHYFK1XEMYG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:49.840" grpc.time_ms=10.261 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1837gitlab # [ 246.644844] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 691838gitlab # [ 246.704471] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8fedef3ff623b8f1c7fe265f","created_at":"2026-10-03T07:00:47.876Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:47.879Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8fedef3ff623b8f1c7fe265f: done: 0.075802 sec","job_status":"done","queue_duration_s":1.956427,"scheduling_latency_s":1.956467,"redis_calls":10,"redis_duration_s":0.006104,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00394,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001666,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000249753,"duration_s":0.075802,"completed_at":"2026-10-03T07:00:49.911Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016878,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1839gitlab # [ 246.727768] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.915Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"40812656e0de4f1887638118","created_at":"2026-10-03T07:00:48.061Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.068Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-40812656e0de4f1887638118: start","job_status":"start","queue_duration_s":1.846942,"scheduling_latency_s":1.846957}1840gitlab # [ 246.728863] gitlab-workhorse[823]: time="2026-10-03T07:00:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671841gitlab # [ 246.729639] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 711842gitlab # [ 246.730565] gitaly[905]: time="2026-10-03T07:00:49.924Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4091H1X9GYBZA1NCT2BX4XD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:49.912" pid=905 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1843gitlab # [ 246.734618] gitaly[905]: time="2026-10-03T07:00:49.924Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4091H1X9GYBZA1NCT2BX4XD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:49.912" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1844gitlab # [ 246.747450] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.941Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"40812656e0de4f1887638118","created_at":"2026-10-03T07:00:48.061Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.068Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-40812656e0de4f1887638118: done: 0.025889 sec","job_status":"done","queue_duration_s":1.846942,"scheduling_latency_s":1.846957,"redis_calls":10,"redis_duration_s":0.002365,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218184,"duration_s":0.025889,"completed_at":"2026-10-03T07:00:49.941Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006678,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1845gitlab # [ 246.795761] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"22b0458e104bd739845b513a","created_at":"2026-10-03T07:00:48.085Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.092Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-22b0458e104bd739845b513a: start","job_status":"start","queue_duration_s":1.849911,"scheduling_latency_s":1.849926}1846gitlab # [ 246.801985] gitaly[905]: time="2026-10-03T07:00:49.924Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4091H1X9GYBZA1NCT2BX4XD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:49.912" grpc.time_ms=11.546 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1847gitlab # [ 246.849675] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.962Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"22b0458e104bd739845b513a","created_at":"2026-10-03T07:00:48.085Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.092Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-22b0458e104bd739845b513a: done: 0.020278 sec","job_status":"done","queue_duration_s":1.849911,"scheduling_latency_s":1.849926,"redis_calls":10,"redis_duration_s":0.0012599999999999998,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203936,"duration_s":0.020278,"completed_at":"2026-10-03T07:00:49.962Z","load_balancing_strategy":"primary","db_duration_s":0.003108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1848gitlab # [ 246.889056] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:49.963Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9963e50a28020ae8d30a73fc","created_at":"2026-10-03T07:00:48.108Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.113Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9963e50a28020ae8d30a73fc: start","job_status":"start","queue_duration_s":1.850225,"scheduling_latency_s":1.850237}1849gitlab # [ 246.889952] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.020Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9963e50a28020ae8d30a73fc","created_at":"2026-10-03T07:00:48.108Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.113Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9963e50a28020ae8d30a73fc: done: 0.056911 sec","job_status":"done","queue_duration_s":1.850225,"scheduling_latency_s":1.850237,"redis_calls":13,"redis_duration_s":0.0017850000000000001,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000395,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219581,"duration_s":0.056911,"completed_at":"2026-10-03T07:00:50.020Z","load_balancing_strategy":"primary","db_duration_s":0.003027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1850gitlab # [ 246.909018] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.021Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2bf50c323b65beac3facb7a5","created_at":"2026-10-03T07:00:48.113Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.118Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2bf50c323b65beac3facb7a5: start","job_status":"start","queue_duration_s":1.902756,"scheduling_latency_s":1.902772}1851gitlab # [ 246.924105] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.042Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2bf50c323b65beac3facb7a5","created_at":"2026-10-03T07:00:48.113Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.118Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2bf50c323b65beac3facb7a5: done: 0.021086 sec","job_status":"done","queue_duration_s":1.902756,"scheduling_latency_s":1.902772,"redis_calls":10,"redis_duration_s":0.0013059999999999999,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023774,"duration_s":0.021086,"completed_at":"2026-10-03T07:00:50.042Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002925,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1852gitlab # [ 246.966084] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.043Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bb5f53d5ffdee3f54fc09e06","created_at":"2026-10-03T07:00:48.119Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.124Z","job_size_bytes":19,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bb5f53d5ffdee3f54fc09e06: start","job_status":"start","queue_duration_s":1.919259,"scheduling_latency_s":1.919272}1853gitlab # [ 247.007764] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.061Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bb5f53d5ffdee3f54fc09e06","created_at":"2026-10-03T07:00:48.119Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.124Z","job_size_bytes":19,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bb5f53d5ffdee3f54fc09e06: done: 0.017798 sec","job_status":"done","queue_duration_s":1.919259,"scheduling_latency_s":1.919272,"redis_calls":11,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198908,"duration_s":0.017798,"completed_at":"2026-10-03T07:00:50.061Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1854gitlab # [ 247.019273] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.062Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e93aab11b2c20d8a911362fd","created_at":"2026-10-03T07:00:48.126Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.128Z","job_size_bytes":66,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e93aab11b2c20d8a911362fd: start","job_status":"start","queue_duration_s":1.933445,"scheduling_latency_s":1.933458}1855gitlab # [ 247.059040] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.115Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e93aab11b2c20d8a911362fd","created_at":"2026-10-03T07:00:48.126Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.128Z","job_size_bytes":66,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e93aab11b2c20d8a911362fd: done: 0.053121 sec","job_status":"done","queue_duration_s":1.933445,"scheduling_latency_s":1.933458,"redis_calls":10,"redis_duration_s":0.001408,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000232152,"duration_s":0.053121,"completed_at":"2026-10-03T07:00:50.115Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1856gitlab # [ 247.077122] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.116Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"52611e98c980e9c913a1dd79","created_at":"2026-10-03T07:00:48.129Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.134Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-52611e98c980e9c913a1dd79: start","job_status":"start","queue_duration_s":1.982006,"scheduling_latency_s":1.98202}1857gitlab # [ 247.120833] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.144Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"52611e98c980e9c913a1dd79","created_at":"2026-10-03T07:00:48.129Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.134Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-52611e98c980e9c913a1dd79: done: 0.028209 sec","job_status":"done","queue_duration_s":1.982006,"scheduling_latency_s":1.98202,"redis_calls":10,"redis_duration_s":0.001397,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000242209,"duration_s":0.028209,"completed_at":"2026-10-03T07:00:50.144Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1858gitlab # [ 247.131809] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.145Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3da897306465ab64511746be","created_at":"2026-10-03T07:00:48.144Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.149Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3da897306465ab64511746be: start","job_status":"start","queue_duration_s":1.995525,"scheduling_latency_s":1.995539}1859gitlab # [ 247.176883] gitaly[905]: time="2026-10-03T07:00:50.278Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ diskcache=dc0ac28d-bbc4-4fd2-a073-14245dfc5848 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-03T13:00:50.267" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:50.267" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860gitlab # [ 247.177723] gitaly[905]: time="2026-10-03T07:00:50.278Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-03T13:00:50.267" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:50.267" grpc.time_ms=10.627 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe'1862gitlab # [ 247.178571] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.167Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3da897306465ab64511746be","created_at":"2026-10-03T07:00:48.144Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.149Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3da897306465ab64511746be: done: 0.021523 sec","job_status":"done","queue_duration_s":1.995525,"scheduling_latency_s":1.995539,"redis_calls":10,"redis_duration_s":0.0012590000000000001,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204495,"duration_s":0.021523,"completed_at":"2026-10-03T07:00:50.166Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1863gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe', in 0.03 seconds)1864gitlab # [ 247.207437] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.168Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"db47ab47e25247371b2c3e04","created_at":"2026-10-03T07:00:48.150Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.156Z","job_size_bytes":6,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-db47ab47e25247371b2c3e04: start","job_status":"start","queue_duration_s":2.011649,"scheduling_latency_s":2.011662}1865gitlab # [ 247.248191] gitaly[905]: time="2026-10-03T07:00:50.301Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:20.300" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:50.300" grpc.time_ms=0.41 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 247.249088] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.181Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"db47ab47e25247371b2c3e04","created_at":"2026-10-03T07:00:48.150Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.156Z","job_size_bytes":6,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-db47ab47e25247371b2c3e04: done: 0.013463 sec","job_status":"done","queue_duration_s":2.011649,"scheduling_latency_s":2.011662,"redis_calls":10,"redis_duration_s":0.001318,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205334,"duration_s":0.013463,"completed_at":"2026-10-03T07:00:50.181Z","load_balancing_strategy":"primary","db_duration_s":0.001235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1867gitlab # [ 247.271311] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.182Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e40bcf32e6326754fb6541fa","created_at":"2026-10-03T07:00:48.157Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.162Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e40bcf32e6326754fb6541fa: start","job_status":"start","queue_duration_s":2.019842,"scheduling_latency_s":2.019855}1868gitlab # [ 247.310067] gitaly[905]: time="2026-10-03T07:00:50.307Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-03T07:01:00.182" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:50.302" grpc.time_ms=4.833 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab # [ 247.310973] nixbot[2646]: INFO: ::ffff:127.0.0.1:33178 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 200 OK1870gitlab # [ 247.311680] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e40bcf32e6326754fb6541fa","created_at":"2026-10-03T07:00:48.157Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.162Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e40bcf32e6326754fb6541fa: done: 0.019825 sec","job_status":"done","queue_duration_s":2.019842,"scheduling_latency_s":2.019855,"redis_calls":10,"redis_duration_s":0.001317,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215111,"duration_s":0.019825,"completed_at":"2026-10-03T07:00:50.202Z","load_balancing_strategy":"primary","db_duration_s":0.003527,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1871gitlab # [ 247.354084] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.203Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"16731fe192cd125c39af0b5e","created_at":"2026-10-03T07:00:48.170Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.176Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-16731fe192cd125c39af0b5e: start","job_status":"start","queue_duration_s":2.027538,"scheduling_latency_s":2.027552}1872gitlab # [ 247.354868] gitaly[905]: time="2026-10-03T07:00:50.326Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-03T07:01:20.325" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:50.326" grpc.time_ms=0.421 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1873gitlab # [ 247.361934] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.239Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"16731fe192cd125c39af0b5e","created_at":"2026-10-03T07:00:48.170Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.176Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-16731fe192cd125c39af0b5e: done: 0.036459 sec","job_status":"done","queue_duration_s":2.027538,"scheduling_latency_s":2.027552,"redis_calls":14,"redis_duration_s":0.0018570000000000001,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219581,"duration_s":0.036459,"completed_at":"2026-10-03T07:00:50.239Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1874gitlab # [ 247.405771] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.240Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"04432adbf040c9a8a17e781e","created_at":"2026-10-03T07:00:48.259Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.261Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-04432adbf040c9a8a17e781e: start","job_status":"start","queue_duration_s":1.979254,"scheduling_latency_s":1.979267}1875gitlab # [ 247.414866] gitaly[905]: time="2026-10-03T07:00:50.332Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-03T07:01:20.328" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:50.328" grpc.time_ms=4.122 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 247.429696] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.256Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"04432adbf040c9a8a17e781e","created_at":"2026-10-03T07:00:48.259Z","trace_propagation_headers":{"sentry-trace":"0449a71e053f48a38043f7c28c775b86-fadaf82b39934b33","baggage":"sentry-trace_id=0449a71e053f48a38043f7c28c775b86,sentry-release=Unknown"},"correlation_id":"01M40905JM8EHVAV6T2EYPJ3DG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.261Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-04432adbf040c9a8a17e781e: done: 0.015115 sec","job_status":"done","queue_duration_s":1.979254,"scheduling_latency_s":1.979267,"redis_calls":8,"redis_duration_s":0.001024,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015115,"completed_at":"2026-10-03T07:00:50.256Z","load_balancing_strategy":"primary","db_duration_s":0.002127,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1877gitlab # [ 247.475512] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.256Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"4a30f0da7c683aa14309a45b","created_at":"2026-10-03T07:00:48.406Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-dede452721cc4a62","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"a85b23d3a0e32732f7865250","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.415Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-4a30f0da7c683aa14309a45b: start","job_status":"start","queue_duration_s":1.841304,"scheduling_latency_s":1.841317}1878gitlab # [ 247.481887] gitaly[905]: time="2026-10-03T07:00:50.350Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:01:00.226" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:50.346" grpc.time_ms=4.325 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab # [ 247.494081] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.287Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"4a30f0da7c683aa14309a45b","created_at":"2026-10-03T07:00:48.406Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-dede452721cc4a62","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"a85b23d3a0e32732f7865250","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.415Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-4a30f0da7c683aa14309a45b: done: 0.03021 sec","job_status":"done","queue_duration_s":1.841304,"scheduling_latency_s":1.841317,"gitaly_calls":1,"gitaly_duration_s":0.012215,"redis_calls":12,"redis_duration_s":0.001634,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000377,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.019858948,"duration_s":0.03021,"completed_at":"2026-10-03T07:00:50.287Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1880gitlab # [ 247.554493] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.288Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b1eb5af132e3f270a19458b2","created_at":"2026-10-03T07:00:48.580Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-dede452721cc4a62","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3e0511075e551fba4e9a19467ecbfb195c94321a9d68a7e34350bb57e6ccd63b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.584Z","job_size_bytes":467,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b1eb5af132e3f270a19458b2: start","job_status":"start","queue_duration_s":1.703955,"scheduling_latency_s":1.703969}1881gitlab # [ 247.555283] gitaly[905]: time="2026-10-03T07:00:50.761Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=47 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=47 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-03T07:01:20.703" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:50.704" grpc.time_ms=57.091 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 247.564889] gitaly[905]: time="2026-10-03T07:00:50.772Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091BXASDVK7BYXVHN7KDGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-03T07:01:20.763" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:50.764" grpc.time_ms=7.92 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 247.576982] sidekiq-cluster[2520]: {"severity":"WARN","time":"2026-10-03T07:00:50.781Z","class":"CreatePipelineWorker","correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"1136d72de7cdb05e5647e7cc9474920fc4a06039","after":"f4cbbac2e60157e60cc76ced6ffe55e6880510fe","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f4cbbac2e60157e60cc76ced6ffe55e6880510fe","ref":"refs/heads/master"},"retry":0}1884gitlab # [ 247.583733] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.785Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b1eb5af132e3f270a19458b2","created_at":"2026-10-03T07:00:48.580Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-dede452721cc4a62","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3e0511075e551fba4e9a19467ecbfb195c94321a9d68a7e34350bb57e6ccd63b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.584Z","job_size_bytes":467,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b1eb5af132e3f270a19458b2: done: 0.497124 sec","job_status":"done","queue_duration_s":1.703955,"scheduling_latency_s":1.703969,"gitaly_calls":7,"gitaly_duration_s":0.089778,"redis_calls":33,"redis_duration_s":0.003092,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000357,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001336,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000709,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.394765,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.497124,"completed_at":"2026-10-03T07:00:50.785Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009767,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1885gitlab # [ 247.660544] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.786Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7b1b26cb-3137-4de1-825b-525db87361e9\"}"],"class":"WebHookWorker","jid":"92a2c56507740816ab28ea58","created_at":"2026-10-03T07:00:48.605Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-dede452721cc4a62","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b19314dd8553ed02eeddc60f2ac2d97c3bfa946da49f8c819c5ba77ff22ef98","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.607Z","job_size_bytes":1749,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-92a2c56507740816ab28ea58: start","job_status":"start","queue_duration_s":2.178457,"scheduling_latency_s":2.178475}1886gitlab # [ 247.661270] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.811Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7b1b26cb-3137-4de1-825b-525db87361e9\"}"],"class":"WebHookWorker","jid":"92a2c56507740816ab28ea58","created_at":"2026-10-03T07:00:48.605Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-dede452721cc4a62","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b19314dd8553ed02eeddc60f2ac2d97c3bfa946da49f8c819c5ba77ff22ef98","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.607Z","job_size_bytes":1749,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-92a2c56507740816ab28ea58: done: 0.025184 sec","job_status":"done","queue_duration_s":2.178457,"scheduling_latency_s":2.178475,"redis_calls":14,"redis_duration_s":0.001912,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000384,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000612,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.005223849000003611,"cpu_s":0.014947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.025184,"completed_at":"2026-10-03T07:00:50.811Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001149,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1887gitlab # [ 247.706872] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.812Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"d6557290a1a5d94ff2300249","created_at":"2026-10-03T07:00:48.784Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-9dad05b4b4ae42ae","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.788Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-d6557290a1a5d94ff2300249: start","job_status":"start","queue_duration_s":2.024504,"scheduling_latency_s":2.024518}1888gitlab # [ 247.707729] nixbot[2646]: INFO: ::ffff:127.0.0.1:33186 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1889gitlab # [ 247.709752] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.840Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"d6557290a1a5d94ff2300249","created_at":"2026-10-03T07:00:48.784Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-9dad05b4b4ae42ae","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:48.788Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-d6557290a1a5d94ff2300249: done: 0.028359 sec","job_status":"done","queue_duration_s":2.024504,"scheduling_latency_s":2.024518,"redis_calls":19,"redis_duration_s":0.002385,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00031,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001141,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004601981,"duration_s":0.028359,"completed_at":"2026-10-03T07:00:50.840Z","load_balancing_strategy":"primary","db_duration_s":0.004585,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1890gitlab # [ 247.755617] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.842Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b9ce00ec70a4a5d8ce7a5786"],"class":"WebHooks::LogExecutionWorker","jid":"7b3a9ed102ded358edff383c","created_at":"2026-10-03T07:00:49.759Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-5572264a9c854090","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c8e2e9a5784dea1f35f5fa60b03c13ed0d9977bb71506d5520e071872bd20054","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:49.767Z","job_size_bytes":2593,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7b3a9ed102ded358edff383c: start","job_status":"start","queue_duration_s":1.074725,"scheduling_latency_s":1.074739}1891gitlab # [ 247.756869] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.869Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b9ce00ec70a4a5d8ce7a5786"],"class":"WebHooks::LogExecutionWorker","jid":"7b3a9ed102ded358edff383c","created_at":"2026-10-03T07:00:49.759Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-5572264a9c854090","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c8e2e9a5784dea1f35f5fa60b03c13ed0d9977bb71506d5520e071872bd20054","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:49.767Z","job_size_bytes":2593,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7b3a9ed102ded358edff383c: done: 0.027666 sec","job_status":"done","queue_duration_s":1.074725,"scheduling_latency_s":1.074739,"redis_calls":10,"redis_duration_s":0.001309,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000247238,"duration_s":0.027666,"completed_at":"2026-10-03T07:00:50.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1892gitlab # [ 247.798679] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.870Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","92a2c56507740816ab28ea58"],"class":"WebHooks::LogExecutionWorker","jid":"db8b099587cb51893548144b","created_at":"2026-10-03T07:00:50.806Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-34b11f7e1c6e4dd3","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:97cd70d99d114515af4555e6d944bdb2592f3b4b6251a051491f03cc8cc95063","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:50.807Z","job_size_bytes":2592,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-db8b099587cb51893548144b: start","job_status":"start","queue_duration_s":0.062927,"scheduling_latency_s":0.06294}1893gitlab # [ 247.811768] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.886Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","92a2c56507740816ab28ea58"],"class":"WebHooks::LogExecutionWorker","jid":"db8b099587cb51893548144b","created_at":"2026-10-03T07:00:50.806Z","trace_propagation_headers":{"sentry-trace":"125ef1c944644f5f98baf558fe821a25-34b11f7e1c6e4dd3","baggage":"sentry-trace_id=125ef1c944644f5f98baf558fe821a25,sentry-release=Unknown"},"correlation_id":"01M4091BXASDVK7BYXVHN7KDGJ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:97cd70d99d114515af4555e6d944bdb2592f3b4b6251a051491f03cc8cc95063","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:50.807Z","job_size_bytes":2592,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-db8b099587cb51893548144b: done: 0.015561 sec","job_status":"done","queue_duration_s":0.062927,"scheduling_latency_s":0.06294,"redis_calls":7,"redis_duration_s":0.000968,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015561,"completed_at":"2026-10-03T07:00:50.886Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003048,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1894gitlab # [ 247.881843] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.887Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"23ed360aadaea6f661d3aa00","created_at":"2026-10-03T07:00:50.832Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-5c4487fdb6274ab6","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:50.835Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-23ed360aadaea6f661d3aa00: start","job_status":"start","queue_duration_s":0.051214,"scheduling_latency_s":0.051228}1895gitlab # [ 247.882642] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:50.944Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"23ed360aadaea6f661d3aa00","created_at":"2026-10-03T07:00:50.832Z","trace_propagation_headers":{"sentry-trace":"eacf6e1b8f9b453f96b9c80c3d1883f8-5c4487fdb6274ab6","baggage":"sentry-trace_id=eacf6e1b8f9b453f96b9c80c3d1883f8,sentry-release=Unknown"},"correlation_id":"01M40900QK9ARNFCNFPDWMY2DN","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:50.835Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-23ed360aadaea6f661d3aa00: done: 0.057622 sec","job_status":"done","queue_duration_s":0.051214,"scheduling_latency_s":0.051228,"redis_calls":11,"redis_duration_s":0.001749,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000242489,"duration_s":0.057622,"completed_at":"2026-10-03T07:00:50.944Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1896gitlab # [ 247.996739] gitaly[905]: time="2026-10-03T07:00:51.204Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4091H46EAZR6C2B3PFGJ80A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.192" pid=905 remote_ip="2001:db8:1::1" request_sha=f6b53fa0904f3b4f5bab993497dc61e8576cf8e6 response_bytes=337 span.kind=server system=grpc1897gitlab # [ 247.996948] gitaly[905]: time="2026-10-03T07:00:51.204Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4091H46EAZR6C2B3PFGJ80A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.192" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1898gitlab # [ 247.997534] gitaly[905]: time="2026-10-03T07:00:51.204Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4091H46EAZR6C2B3PFGJ80A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.192" grpc.time_ms=11.643 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1899gitlab # [ 247.998431] gitlab-workhorse[823]: time="2026-10-03T07:00:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371900gitlab # [ 247.999063] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 12781901gitlab # [ 248.031843] nixbot[2646]: {"ts": "2026-10-03T07:00:51.239Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1902gitlab # [ 248.072373] gitaly[905]: time="2026-10-03T07:00:51.280Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091JD6A567ZB24J0NCF3TH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.271" grpc.time_ms=8.349 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1903gitlab # [ 248.073375] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421904gitlab # [ 248.088068] gitaly[905]: time="2026-10-03T07:00:51.295Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:21.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:51.295" grpc.time_ms=0.519 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab # [ 248.131608] gitaly[905]: time="2026-10-03T07:00:51.339Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:01:01.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:51.334" grpc.time_ms=4.991 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 248.144282] gitaly[905]: time="2026-10-03T07:00:51.341Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4091JEJS8CKNJNXFMHM6C17 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.335" pid=905 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1907gitlab # [ 248.144774] gitlab-workhorse[823]: time="2026-10-03T07:00:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671908gitlab # [ 248.145199] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 591909gitlab # [ 248.145740] gitaly[905]: time="2026-10-03T07:00:51.341Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091JEJS8CKNJNXFMHM6C17 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.335" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1910gitlab # [ 248.146491] gitaly[905]: time="2026-10-03T07:00:51.341Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091JEJS8CKNJNXFMHM6C17 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.335" grpc.time_ms=6.122 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1911gitlab # [ 248.155802] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.363Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"41710fff3db89801c6186050","created_at":"2026-10-03T07:00:51.359Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-bf8767e8d6b84126","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.362Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-41710fff3db89801c6186050: start","job_status":"start","queue_duration_s":0.001266,"scheduling_latency_s":0.001296}1912gitlab # [ 248.166264] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1211913gitlab # [ 248.166924] nixbot[2646]: {"ts": "2026-10-03T07:00:51.372Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 \"HTTP/1.1 201 Created\""}1914gitlab # [ 248.214922] gitaly[905]: time="2026-10-03T07:00:51.422Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091JHGE6PAPS1PS82NA71W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:21.221" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:51.422" grpc.time_ms=0.45 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915gitlab # [ 248.231539] gitaly[905]: time="2026-10-03T07:00:51.439Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:51.438" grpc.time_ms=0.233 pid=905 span.kind=server system=grpc1916gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe'1917gitlab # [ 248.259388] gitaly[905]: time="2026-10-03T07:00:51.467Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:51.466" grpc.time_ms=0.221 pid=905 span.kind=server system=grpc1918gitlab # [ 248.272645] gitaly[905]: time="2026-10-03T07:00:51.479Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=9 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091JHGE6PAPS1PS82NA71W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:01:01.065" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:51.465" grpc.time_ms=13.603 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe', in 0.05 seconds)1920gitlab # [ 248.294524] gitaly[905]: time="2026-10-03T07:00:51.502Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091JKXH6V209DCEH1ZGQMN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.495" grpc.time_ms=6.449 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1921gitlab # [ 248.295376] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 491922gitlab # [ 248.297211] nixbot[2646]: INFO: ::ffff:127.0.0.1:33190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 200 OK1923gitlab # [ 248.301192] gitaly[905]: time="2026-10-03T07:00:51.508Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:51.508" grpc.time_ms=0.376 pid=905 span.kind=server system=grpc1924gitlab # [ 248.327347] gitaly[905]: time="2026-10-03T07:00:51.534Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC diskcache=fadda9ac-9828-43d9-a1ac-c61a3d39311d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:21.417" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:51.417" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925gitlab # [ 248.329066] gitaly[905]: time="2026-10-03T07:00:51.535Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=79 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7412 command.oublock=0 command.real_time_ms=109 command.spawn_token_fork_ms=0 command.system_time_ms=53 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:21.417" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:51.417" grpc.time_ms=117.156 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926gitlab # [ 248.358561] gitaly[905]: time="2026-10-03T07:00:51.566Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4091JNGDBVKEKM4XYSNHTJE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.556" pid=905 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1927gitlab # [ 248.358942] gitaly[905]: time="2026-10-03T07:00:51.566Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4091JNGDBVKEKM4XYSNHTJE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.556" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1928gitlab # [ 248.360115] gitaly[905]: time="2026-10-03T07:00:51.566Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4091JNGDBVKEKM4XYSNHTJE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:51.556" grpc.time_ms=10.019 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1929gitlab # [ 248.373199] gitaly[905]: time="2026-10-03T07:00:51.580Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-03T07:01:21.580" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:51.580" grpc.time_ms=0.544 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930gitlab # [ 248.391452] gitaly[905]: time="2026-10-03T07:00:51.599Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:21.598" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:51.598" grpc.time_ms=0.478 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 248.417588] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2471932gitlab # [ 248.417921] gitlab-workhorse[823]: time="2026-10-03T07:00:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161933gitlab # [ 248.418541] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1201934gitlab # [ 248.419362] nixbot[2646]: {"ts": "2026-10-03T07:00:51.625Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 \"HTTP/1.1 201 Created\""}1935gitlab # [ 248.424138] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.631Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3ced0c0919d161685fcd9353","created_at":"2026-10-03T07:00:51.628Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"41710fff3db89801c6186050","job_size_bytes":3,"pid":2520,"job_status":"deduplicated","message":"PipelineProcessWorker JID-3ced0c0919d161685fcd9353: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1936gitlab # [ 248.425526] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.632Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"41710fff3db89801c6186050","created_at":"2026-10-03T07:00:51.359Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-bf8767e8d6b84126","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.362Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2520,"job_status":"rescheduled","message":"PipelineProcessWorker JID-41710fff3db89801c6186050: rescheduled"}1937gitlab # [ 248.429394] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.636Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"41710fff3db89801c6186050","created_at":"2026-10-03T07:00:51.359Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-bf8767e8d6b84126","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.362Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-41710fff3db89801c6186050: done: 0.273758 sec","job_status":"done","queue_duration_s":0.001266,"scheduling_latency_s":0.001296,"gitaly_calls":3,"gitaly_duration_s":0.124178,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015491,"redis_read_bytes":226,"redis_write_bytes":18468,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000426,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000588,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002234,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.010092,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000175,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000369,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001181,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":18,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104908,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.218890389,"duration_s":0.273758,"completed_at":"2026-10-03T07:00:51.636Z","load_balancing_strategy":"primary","db_duration_s":0.032509,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1938gitlab # [ 248.475070] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.643Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4b027066ca410a324c5841e1","created_at":"2026-10-03T07:00:51.410Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.413Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4b027066ca410a324c5841e1: start","job_status":"start","queue_duration_s":0.229431,"scheduling_latency_s":0.229449}1939gitlab # [ 248.475994] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4b027066ca410a324c5841e1","created_at":"2026-10-03T07:00:51.410Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.413Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4b027066ca410a324c5841e1: done: 0.024661 sec","job_status":"done","queue_duration_s":0.229431,"scheduling_latency_s":0.229449,"redis_calls":7,"redis_duration_s":0.0009270000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024661,"completed_at":"2026-10-03T07:00:51.667Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004372,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1940gitlab # [ 248.539307] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.668Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e760f7b1ffc54c15beea727b","created_at":"2026-10-03T07:00:51.542Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.545Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e760f7b1ffc54c15beea727b: start","job_status":"start","queue_duration_s":0.123217,"scheduling_latency_s":0.123231}1941gitlab # [ 248.539955] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.686Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e760f7b1ffc54c15beea727b","created_at":"2026-10-03T07:00:51.542Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.545Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e760f7b1ffc54c15beea727b: done: 0.017665 sec","job_status":"done","queue_duration_s":0.123217,"scheduling_latency_s":0.123231,"redis_calls":7,"redis_duration_s":0.003438,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001253,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002185,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017665,"completed_at":"2026-10-03T07:00:51.686Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1942gitlab # [ 248.594033] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"611abd2f7c8082c9c3200e2f","created_at":"2026-10-03T07:00:51.549Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.551Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-611abd2f7c8082c9c3200e2f: start","job_status":"start","queue_duration_s":0.137595,"scheduling_latency_s":0.137609}1943gitlab # [ 248.594701] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.712Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"611abd2f7c8082c9c3200e2f","created_at":"2026-10-03T07:00:51.549Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.551Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-611abd2f7c8082c9c3200e2f: done: 0.023882 sec","job_status":"done","queue_duration_s":0.137595,"scheduling_latency_s":0.137609,"redis_calls":7,"redis_duration_s":0.003136,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002489,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000647,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023882,"completed_at":"2026-10-03T07:00:51.712Z","load_balancing_strategy":"primary","db_duration_s":0.007111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1944gitlab # [ 248.638596] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4b3a2555825ee783bcca73ed","created_at":"2026-10-03T07:00:51.556Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.558Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4b3a2555825ee783bcca73ed: start","job_status":"start","queue_duration_s":0.155006,"scheduling_latency_s":0.15502}1945gitlab # [ 248.639576] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.731Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4b3a2555825ee783bcca73ed","created_at":"2026-10-03T07:00:51.556Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.558Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4b3a2555825ee783bcca73ed: done: 0.0182 sec","job_status":"done","queue_duration_s":0.155006,"scheduling_latency_s":0.15502,"redis_calls":10,"redis_duration_s":0.001595,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000389,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0182,"completed_at":"2026-10-03T07:00:51.731Z","load_balancing_strategy":"primary","db_duration_s":0.002587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1946gitlab # [ 248.689376] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.732Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b76f6c6ac55a50e108af72a0","created_at":"2026-10-03T07:00:51.559Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.560Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b76f6c6ac55a50e108af72a0: start","job_status":"start","queue_duration_s":0.172713,"scheduling_latency_s":0.172725}1947gitlab # [ 248.692132] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.747Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b76f6c6ac55a50e108af72a0","created_at":"2026-10-03T07:00:51.559Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.560Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b76f6c6ac55a50e108af72a0: done: 0.014532 sec","job_status":"done","queue_duration_s":0.172713,"scheduling_latency_s":0.172725,"redis_calls":7,"redis_duration_s":0.001075,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014532,"completed_at":"2026-10-03T07:00:51.747Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1948gitlab # [ 248.736501] gitaly[905]: time="2026-10-03T07:00:51.881Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-03T07:01:21.879" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:51.880" grpc.time_ms=0.753 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 248.742756] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.752Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ddb5c09987846ebb5e1ad42a","created_at":"2026-10-03T07:00:51.560Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.563Z","job_size_bytes":19,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ddb5c09987846ebb5e1ad42a: start","job_status":"start","queue_duration_s":0.188607,"scheduling_latency_s":0.188622}1950gitlab # [ 248.783755] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.769Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ddb5c09987846ebb5e1ad42a","created_at":"2026-10-03T07:00:51.560Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.563Z","job_size_bytes":19,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ddb5c09987846ebb5e1ad42a: done: 0.017029 sec","job_status":"done","queue_duration_s":0.188607,"scheduling_latency_s":0.188622,"redis_calls":8,"redis_duration_s":0.0026219999999999998,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00065,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017029,"completed_at":"2026-10-03T07:00:51.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1951gitlab # [ 248.829724] gitaly[905]: time="2026-10-03T07:00:51.904Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091JDHHRSGYXRBE6NQQSZC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:21.001" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:51.902" grpc.time_ms=1.754 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab # [ 248.830581] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.770Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2d53dffb3beb23a9318f21fe","created_at":"2026-10-03T07:00:51.564Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.565Z","job_size_bytes":66,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2d53dffb3beb23a9318f21fe: start","job_status":"start","queue_duration_s":0.204902,"scheduling_latency_s":0.204924}1953gitlab # [ 248.831190] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.782Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2d53dffb3beb23a9318f21fe","created_at":"2026-10-03T07:00:51.564Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.565Z","job_size_bytes":66,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2d53dffb3beb23a9318f21fe: done: 0.012686 sec","job_status":"done","queue_duration_s":0.204902,"scheduling_latency_s":0.204924,"redis_calls":7,"redis_duration_s":0.001012,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000355,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012686,"completed_at":"2026-10-03T07:00:51.782Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1954gitlab # [ 248.870808] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.783Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f11ce772f47a37310a34012a","created_at":"2026-10-03T07:00:51.565Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.567Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f11ce772f47a37310a34012a: start","job_status":"start","queue_duration_s":0.215945,"scheduling_latency_s":0.215959}1955gitlab # [ 248.911920] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f11ce772f47a37310a34012a","created_at":"2026-10-03T07:00:51.565Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.567Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f11ce772f47a37310a34012a: done: 0.015606 sec","job_status":"done","queue_duration_s":0.215945,"scheduling_latency_s":0.215959,"redis_calls":7,"redis_duration_s":0.00091,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015606,"completed_at":"2026-10-03T07:00:51.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1956gitlab # [ 248.913056] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.800Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0d534ebcb8ef6faae8965c8e","created_at":"2026-10-03T07:00:51.568Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.570Z","job_size_bytes":6,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0d534ebcb8ef6faae8965c8e: start","job_status":"start","queue_duration_s":0.229541,"scheduling_latency_s":0.229556}1957gitlab # [ 248.951952] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.812Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0d534ebcb8ef6faae8965c8e","created_at":"2026-10-03T07:00:51.568Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.570Z","job_size_bytes":6,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0d534ebcb8ef6faae8965c8e: done: 0.012809 sec","job_status":"done","queue_duration_s":0.229541,"scheduling_latency_s":0.229556,"redis_calls":7,"redis_duration_s":0.0009209999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012809,"completed_at":"2026-10-03T07:00:51.812Z","load_balancing_strategy":"primary","db_duration_s":0.00025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1958gitlab # [ 248.996910] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.813Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"11465130ccb942e42faa6e76","created_at":"2026-10-03T07:00:51.571Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.571Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-11465130ccb942e42faa6e76: start","job_status":"start","queue_duration_s":0.241837,"scheduling_latency_s":0.241849}1959gitlab # [ 248.997678] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.827Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"11465130ccb942e42faa6e76","created_at":"2026-10-03T07:00:51.571Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.571Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-11465130ccb942e42faa6e76: done: 0.013219 sec","job_status":"done","queue_duration_s":0.241837,"scheduling_latency_s":0.241849,"redis_calls":7,"redis_duration_s":0.000877,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013219,"completed_at":"2026-10-03T07:00:51.826Z","load_balancing_strategy":"primary","db_duration_s":0.001856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1960gitlab # [ 249.038756] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.827Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9734733da7ff141cc564ba6d","created_at":"2026-10-03T07:00:51.633Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.633Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9734733da7ff141cc564ba6d: start","job_status":"start","queue_duration_s":0.193998,"scheduling_latency_s":0.194012}1961gitlab # [ 249.039399] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.911Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9734733da7ff141cc564ba6d","created_at":"2026-10-03T07:00:51.633Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-2191cf3ad16843da","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.633Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9734733da7ff141cc564ba6d: done: 0.084037 sec","job_status":"done","queue_duration_s":0.193998,"scheduling_latency_s":0.194012,"gitaly_calls":2,"gitaly_duration_s":0.005393,"redis_calls":31,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.01063,"redis_read_bytes":55,"redis_write_bytes":4922,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002015,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003771,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_calls":2,"redis_queues_duration_s":0.000181,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001045,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000163,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000827,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000613,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050451,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06478505,"duration_s":0.084037,"completed_at":"2026-10-03T07:00:51.911Z","load_balancing_strategy":"primary","db_duration_s":0.022339,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1962gitlab # [ 249.091956] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.912Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4d0bab9e27fa10b5ee85ce53","created_at":"2026-10-03T07:00:51.870Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-563cfb6baa974b34","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.871Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4d0bab9e27fa10b5ee85ce53: start","job_status":"start","queue_duration_s":0.041543,"scheduling_latency_s":0.041557}1963gitlab # [ 249.092733] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:51.932Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4d0bab9e27fa10b5ee85ce53","created_at":"2026-10-03T07:00:51.870Z","trace_propagation_headers":{"sentry-trace":"be89679caeb84a8eb7be9dc2aad6803e-563cfb6baa974b34","baggage":"sentry-trace_id=be89679caeb84a8eb7be9dc2aad6803e,sentry-release=Unknown"},"correlation_id":"01M4091JDHHRSGYXRBE6NQQSZC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:51.871Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4d0bab9e27fa10b5ee85ce53: done: 0.01959 sec","job_status":"done","queue_duration_s":0.041543,"scheduling_latency_s":0.041557,"redis_calls":7,"redis_duration_s":0.0009059999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01959,"completed_at":"2026-10-03T07:00:51.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002694,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1964gitlab # [ 249.226356] gitaly[905]: time="2026-10-03T07:00:52.433Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:22.231" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:52.432" grpc.time_ms=0.591 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1965gitlab # [ 249.232101] gitaly[905]: time="2026-10-03T07:00:52.439Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:22.238" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:52.439" grpc.time_ms=0.576 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 249.248514] gitaly[905]: time="2026-10-03T07:00:52.456Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-03T07:01:22.247" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.447" grpc.time_ms=8.81 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967gitlab # [ 249.258909] gitaly[905]: time="2026-10-03T07:00:52.466Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:01:02.060" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.461" grpc.time_ms=5.53 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 249.260664] gitaly[905]: time="2026-10-03T07:00:52.468Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:01:02.133" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.463" grpc.time_ms=4.607 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 249.281855] gitaly[905]: time="2026-10-03T07:00:52.489Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-03T07:01:02.089" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:52.489" grpc.time_ms=0.172 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe'1971gitlab # [ 249.287655] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:52.495Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d96405c3d77e1f729d8a27d5","created_at":"2026-10-03T07:00:52.490Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-85dedd526fb0434a","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.493Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d96405c3d77e1f729d8a27d5: start","job_status":"start","queue_duration_s":0.00155,"scheduling_latency_s":0.001581}1972gitlab # [ 249.290935] gitaly[905]: time="2026-10-03T07:00:52.498Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-03T07:01:02.093" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.493" grpc.time_ms=5.274 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 249.300800] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1301974gitlab # [ 249.302173] nixbot[2646]: {"ts": "2026-10-03T07:00:52.509Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1136d72de7cdb05e5647e7cc9474920fc4a06039 \"HTTP/1.1 201 Created\""}1975gitlab # [ 249.340574] gitaly[905]: time="2026-10-03T07:00:52.548Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:52.548" grpc.time_ms=0.284 pid=905 span.kind=server system=grpc1976gitlab # [ 249.355713] nixbot[2646]: INFO: ::ffff:127.0.0.1:33202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 200 OK1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f4cbbac2e60157e60cc76ced6ffe55e6880510fe', in 0.06 seconds)1978(finished: subtest: push delivers the webhook, in 47.63 seconds)1979subtest: eval and build post commit statuses1980gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses1981gitlab # [ 249.370396] gitaly[905]: time="2026-10-03T07:00:52.575Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091KNKS0QVQ8021YP5Z2E2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:52.568" grpc.time_ms=6.496 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1982gitlab # [ 249.370830] gitaly[905]: time="2026-10-03T07:00:52.577Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:52.577" grpc.time_ms=0.276 pid=905 span.kind=server system=grpc1983gitlab # [ 249.372162] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 471984gitlab # [ 249.402077] gitaly[905]: time="2026-10-03T07:00:52.609Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B diskcache=117d2876-d440-4c71-a130-595dc7d8a0b3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-03T07:01:02.100" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:52.500" pid=905 ref=refs/keep-around/f4cbbac2e60157e60cc76ced6ffe55e6880510fe remote_ip="2001:db8:1::1" revision=f4cbbac2e60157e60cc76ced6ffe55e6880510fe span.kind=server system=grpc username=root1985gitlab # [ 249.402476] gitaly[905]: time="2026-10-03T07:00:52.609Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=71 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5382 command.oublock=8 command.real_time_ms=100 command.spawn_token_fork_ms=0 command.system_time_ms=55 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-03T07:01:02.100" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-03T07:00:52.500" grpc.time_ms=108.386 pid=905 ref=refs/keep-around/f4cbbac2e60157e60cc76ced6ffe55e6880510fe remote_ip="2001:db8:1::1" revision=f4cbbac2e60157e60cc76ced6ffe55e6880510fe span.kind=server system=grpc username=root1986gitlab # [ 249.407179] gitaly[905]: time="2026-10-03T07:00:52.614Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:22.413" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:52.614" grpc.time_ms=0.675 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1987gitlab # [ 249.475096] gitaly[905]: time="2026-10-03T07:00:52.682Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4091KQSFWW6AM15AK7GV1GK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:52.675" pid=905 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1988gitlab # [ 249.475514] gitaly[905]: time="2026-10-03T07:00:52.682Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KQSFWW6AM15AK7GV1GK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:52.675" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1989gitlab # [ 249.476163] gitaly[905]: time="2026-10-03T07:00:52.682Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KQSFWW6AM15AK7GV1GK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:52.675" grpc.time_ms=6.914 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc1990gitlab # [ 249.476887] gitlab-workhorse[823]: time="2026-10-03T07:00:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671991gitlab # [ 249.477558] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 821992gitlab # [ 249.480939] gitaly[905]: time="2026-10-03T07:00:52.683Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:52.683" grpc.time_ms=0.231 pid=905 span.kind=server system=grpc1993gitlab # [ 249.539137] gitaly[905]: time="2026-10-03T07:00:52.746Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:52.745" grpc.time_ms=0.31 pid=905 span.kind=server system=grpc1994gitlab # [ 249.548491] gitaly[905]: time="2026-10-03T07:00:52.756Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KR5NJ9EH20ENVVXFZPP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:22.555" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:52.755" grpc.time_ms=0.543 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab # [ 249.569240] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3711996gitlab # [ 249.571716] nixbot[2646]: {"ts": "2026-10-03T07:00:52.778Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f4cbbac2e60157e60cc76ced6ffe55e6880510fe \"HTTP/1.1 201 Created\""}1997gitlab # [ 249.581475] gitaly[905]: time="2026-10-03T07:00:52.789Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:52.788" grpc.time_ms=0.429 pid=905 span.kind=server system=grpc1998gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses, in 0.23 seconds)1999gitlab # [ 249.583787] nixbot[2646]: {"ts": "2026-10-03T07:00:52.791Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-f4cbbac2e601-4"}2000gitlab # [ 249.590505] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1822001gitlab # [ 249.598361] gitaly[905]: time="2026-10-03T07:00:52.806Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:22.656" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.656" operations="[repack_refs]" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab # [ 249.600037] gitaly[905]: time="2026-10-03T07:00:52.807Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:22.656" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.656" pid=905 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-03 06:59:53.814445529 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2003gitlab # [ 249.606043] gitaly[905]: time="2026-10-03T07:00:52.813Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH diskcache=669d501d-4aa9-4db2-9043-b919a93013cb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:22.656" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.656" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 249.607469] gitaly[905]: time="2026-10-03T07:00:52.815Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=94 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7486 command.oublock=0 command.real_time_ms=151 command.spawn_token_fork_ms=0 command.system_time_ms=73 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:22.656" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.656" grpc.time_ms=158.468 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab # [ 249.614130] gitaly[905]: time="2026-10-03T07:00:52.821Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:22.656" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.656" pid=905 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2006gitlab # [ 249.615024] gitaly[905]: time="2026-10-03T07:00:52.822Z" level=info msg="optimized repository" clean_stale_data_time=14.418033ms clean_work_trees_time="67.047µs" commit_graph_time="3.632µs" correlation_id=01M4091KGS6WD7GGRN1HDYYDEH gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.47µs" pid=905 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.191µs" storage_name=default system=housekeeping total_time=14.594313ms2007gitlab # [ 249.616837] gitaly[905]: time="2026-10-03T07:00:52.824Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:22.656" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:52.656" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2008gitlab # [ 249.665676] nixbot[2646]: {"ts": "2026-10-03T07:00:52.873Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f4cbbac2e601-4", "argv0": "bwrap"}2009gitlab # [ 249.712520] gitaly[905]: time="2026-10-03T07:00:52.920Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-03T07:01:22.018" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:52.918" grpc.time_ms=1.223 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 249.720415] nix-daemon[2812]: accepted connection from pid 3653, user nixbot2011gitlab # [ 249.732720] gitaly[905]: time="2026-10-03T07:00:52.940Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KGS6WD7GGRN1HDYYDEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:22.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:52.939" grpc.time_ms=0.716 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab # [ 249.742603] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:52.949Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d96405c3d77e1f729d8a27d5","created_at":"2026-10-03T07:00:52.490Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-85dedd526fb0434a","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.493Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d96405c3d77e1f729d8a27d5: done: 0.454932 sec","job_status":"done","queue_duration_s":0.00155,"scheduling_latency_s":0.001581,"gitaly_calls":3,"gitaly_duration_s":0.223399,"redis_calls":71,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.019187,"redis_read_bytes":154,"redis_write_bytes":19876,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.003985,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001664,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":23,"redis_queues_duration_s":0.002765,"redis_queues_read_bytes":28,"redis_queues_write_bytes":13378,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004311,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000372,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000366,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001739,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.16244,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.421614758,"duration_s":0.454932,"completed_at":"2026-10-03T07:00:52.949Z","load_balancing_strategy":"primary","db_duration_s":0.043599,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2013gitlab # [ 249.750730] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:52.951Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"adaef0325d7bb95746166f1a","created_at":"2026-10-03T07:00:52.620Z","trace_propagation_headers":{"sentry-trace":"df3d88b391844fc1ace3829e156e4f22-8ff3ee7808cc4574","baggage":"sentry-trace_id=df3d88b391844fc1ace3829e156e4f22,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091KHNXF0FJEYGYKR8K16B","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.638Z","job_size_bytes":65,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-adaef0325d7bb95746166f1a: start","job_status":"start","queue_duration_s":0.312625,"scheduling_latency_s":0.312641}2014gitlab # [ 249.847757] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.053Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"adaef0325d7bb95746166f1a","created_at":"2026-10-03T07:00:52.620Z","trace_propagation_headers":{"sentry-trace":"df3d88b391844fc1ace3829e156e4f22-8ff3ee7808cc4574","baggage":"sentry-trace_id=df3d88b391844fc1ace3829e156e4f22,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091KHNXF0FJEYGYKR8K16B","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.638Z","job_size_bytes":65,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-adaef0325d7bb95746166f1a: done: 0.102451 sec","job_status":"done","queue_duration_s":0.312625,"scheduling_latency_s":0.312641,"redis_calls":7,"redis_duration_s":0.0018,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000563,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.102451,"completed_at":"2026-10-03T07:00:53.053Z","load_balancing_strategy":"primary","db_duration_s":0.004428,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2015gitlab # [ 249.849214] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.056Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6508a607eaff19ffe0781b59","created_at":"2026-10-03T07:00:52.646Z","trace_propagation_headers":{"sentry-trace":"df3d88b391844fc1ace3829e156e4f22-8ff3ee7808cc4574","baggage":"sentry-trace_id=df3d88b391844fc1ace3829e156e4f22,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091KHNXF0FJEYGYKR8K16B","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.649Z","job_size_bytes":65,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6508a607eaff19ffe0781b59: start","job_status":"start","queue_duration_s":0.407146,"scheduling_latency_s":0.407176}2016gitlab # [ 249.896878] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.103Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6508a607eaff19ffe0781b59","created_at":"2026-10-03T07:00:52.646Z","trace_propagation_headers":{"sentry-trace":"df3d88b391844fc1ace3829e156e4f22-8ff3ee7808cc4574","baggage":"sentry-trace_id=df3d88b391844fc1ace3829e156e4f22,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091KHNXF0FJEYGYKR8K16B","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.649Z","job_size_bytes":65,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6508a607eaff19ffe0781b59: done: 0.047317 sec","job_status":"done","queue_duration_s":0.407146,"scheduling_latency_s":0.407176,"redis_calls":10,"redis_duration_s":0.002078,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047317,"completed_at":"2026-10-03T07:00:53.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009655,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2017gitlab # [ 249.905330] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.105Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"eedebd43ab795b24c234e6d7","created_at":"2026-10-03T07:00:52.648Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.650Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-eedebd43ab795b24c234e6d7: start","job_status":"start","queue_duration_s":0.455137,"scheduling_latency_s":0.455152}2018gitlab # [ 249.951170] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.132Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"eedebd43ab795b24c234e6d7","created_at":"2026-10-03T07:00:52.648Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.650Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-eedebd43ab795b24c234e6d7: done: 0.026951 sec","job_status":"done","queue_duration_s":0.455137,"scheduling_latency_s":0.455152,"redis_calls":7,"redis_duration_s":0.0013210000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026951,"completed_at":"2026-10-03T07:00:53.132Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006523,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2019gitlab # [ 249.995386] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.133Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a8e7a0da05099ae58534fd71","created_at":"2026-10-03T07:00:52.756Z","trace_propagation_headers":{"sentry-trace":"df3d88b391844fc1ace3829e156e4f22-8ff3ee7808cc4574","baggage":"sentry-trace_id=df3d88b391844fc1ace3829e156e4f22,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091KHNXF0FJEYGYKR8K16B","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.762Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a8e7a0da05099ae58534fd71: start","job_status":"start","queue_duration_s":0.370705,"scheduling_latency_s":0.37072}2020gitlab # [ 249.996615] gitaly[905]: time="2026-10-03T07:00:53.190Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-03T07:01:23.188" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:53.189" grpc.time_ms=1.01 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 250.011379] gitaly[905]: time="2026-10-03T07:00:53.218Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091KHNXF0FJEYGYKR8K16B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:23.217" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:53.218" grpc.time_ms=0.636 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 250.031620] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.238Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a8e7a0da05099ae58534fd71","created_at":"2026-10-03T07:00:52.756Z","trace_propagation_headers":{"sentry-trace":"df3d88b391844fc1ace3829e156e4f22-8ff3ee7808cc4574","baggage":"sentry-trace_id=df3d88b391844fc1ace3829e156e4f22,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091KHNXF0FJEYGYKR8K16B","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.762Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a8e7a0da05099ae58534fd71: done: 0.105068 sec","job_status":"done","queue_duration_s":0.370705,"scheduling_latency_s":0.37072,"gitaly_calls":2,"gitaly_duration_s":0.005814,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.00795,"redis_read_bytes":80,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001102,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001353,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000267,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002023,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000246,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000686,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001171,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065189,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.075253978,"duration_s":0.105068,"completed_at":"2026-10-03T07:00:53.238Z","load_balancing_strategy":"primary","db_duration_s":0.030538,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2023gitlab # [ 250.046950] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.240Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e11c11cb86d8da70eb525990","created_at":"2026-10-03T07:00:52.877Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.879Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e11c11cb86d8da70eb525990: start","job_status":"start","queue_duration_s":0.36086,"scheduling_latency_s":0.360886}2024gitlab # [ 250.063362] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.263Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e11c11cb86d8da70eb525990","created_at":"2026-10-03T07:00:52.877Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.879Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e11c11cb86d8da70eb525990: done: 0.022873 sec","job_status":"done","queue_duration_s":0.36086,"scheduling_latency_s":0.360886,"redis_calls":7,"redis_duration_s":0.001258,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022873,"completed_at":"2026-10-03T07:00:53.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 250.108773] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4e4e4df6f71965075a687bf0","created_at":"2026-10-03T07:00:52.885Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.889Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4e4e4df6f71965075a687bf0: start","job_status":"start","queue_duration_s":0.375207,"scheduling_latency_s":0.375221}2026gitlab # [ 250.119162] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.285Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4e4e4df6f71965075a687bf0","created_at":"2026-10-03T07:00:52.885Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.889Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4e4e4df6f71965075a687bf0: done: 0.020479 sec","job_status":"done","queue_duration_s":0.375207,"scheduling_latency_s":0.375221,"redis_calls":7,"redis_duration_s":0.002352,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001951,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020479,"completed_at":"2026-10-03T07:00:53.285Z","load_balancing_strategy":"primary","db_duration_s":0.004705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027gitlab # [ 250.168862] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.286Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"ac492b3314ca35e7e6423d17","created_at":"2026-10-03T07:00:52.895Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.896Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ac492b3314ca35e7e6423d17: start","job_status":"start","queue_duration_s":0.389415,"scheduling_latency_s":0.389429}2028gitlab # [ 250.172497] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"ac492b3314ca35e7e6423d17","created_at":"2026-10-03T07:00:52.895Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.896Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ac492b3314ca35e7e6423d17: done: 0.023197 sec","job_status":"done","queue_duration_s":0.389415,"scheduling_latency_s":0.389429,"redis_calls":10,"redis_duration_s":0.00231,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00069,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023197,"completed_at":"2026-10-03T07:00:53.309Z","load_balancing_strategy":"primary","db_duration_s":0.005469,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2029gitlab # [ 250.235890] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.310Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9c87d102f543fda884a1df50","created_at":"2026-10-03T07:00:52.897Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.898Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9c87d102f543fda884a1df50: start","job_status":"start","queue_duration_s":0.411907,"scheduling_latency_s":0.411922}2030gitlab # [ 250.237079] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.329Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9c87d102f543fda884a1df50","created_at":"2026-10-03T07:00:52.897Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.898Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9c87d102f543fda884a1df50: done: 0.019131 sec","job_status":"done","queue_duration_s":0.411907,"scheduling_latency_s":0.411922,"redis_calls":7,"redis_duration_s":0.001702,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019131,"completed_at":"2026-10-03T07:00:53.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031gitlab # [ 250.294696] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.331Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f37b81226ad5c4ddc13ae4a2","created_at":"2026-10-03T07:00:52.899Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.900Z","job_size_bytes":19,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f37b81226ad5c4ddc13ae4a2: start","job_status":"start","queue_duration_s":0.431053,"scheduling_latency_s":0.431067}2032gitlab # [ 250.295664] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.348Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f37b81226ad5c4ddc13ae4a2","created_at":"2026-10-03T07:00:52.899Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.900Z","job_size_bytes":19,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f37b81226ad5c4ddc13ae4a2: done: 0.017536 sec","job_status":"done","queue_duration_s":0.431053,"scheduling_latency_s":0.431067,"redis_calls":8,"redis_duration_s":0.001788,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001322,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017536,"completed_at":"2026-10-03T07:00:53.348Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033gitlab # [ 250.338462] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.350Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f34137fb3593d46545ce4bc0","created_at":"2026-10-03T07:00:52.900Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.901Z","job_size_bytes":66,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f34137fb3593d46545ce4bc0: start","job_status":"start","queue_duration_s":0.448744,"scheduling_latency_s":0.448757}2034gitlab # [ 250.339611] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.366Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f34137fb3593d46545ce4bc0","created_at":"2026-10-03T07:00:52.900Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.901Z","job_size_bytes":66,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f34137fb3593d46545ce4bc0: done: 0.015903 sec","job_status":"done","queue_duration_s":0.448744,"scheduling_latency_s":0.448757,"redis_calls":7,"redis_duration_s":0.001533,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015903,"completed_at":"2026-10-03T07:00:53.366Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003402,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 250.382507] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.368Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"ed5da8570a0e48dfb645ff7f","created_at":"2026-10-03T07:00:52.902Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.903Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ed5da8570a0e48dfb645ff7f: start","job_status":"start","queue_duration_s":0.464848,"scheduling_latency_s":0.464861}2036gitlab # [ 250.392768] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.391Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"ed5da8570a0e48dfb645ff7f","created_at":"2026-10-03T07:00:52.902Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.903Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ed5da8570a0e48dfb645ff7f: done: 0.023516 sec","job_status":"done","queue_duration_s":0.464848,"scheduling_latency_s":0.464861,"redis_calls":7,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023516,"completed_at":"2026-10-03T07:00:53.391Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2037gitlab # [ 250.442551] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.392Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"38a7cca3d0220e4c5b7030f2","created_at":"2026-10-03T07:00:52.906Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.907Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-38a7cca3d0220e4c5b7030f2: start","job_status":"start","queue_duration_s":0.485479,"scheduling_latency_s":0.485494}2038gitlab # [ 250.445831] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.411Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"38a7cca3d0220e4c5b7030f2","created_at":"2026-10-03T07:00:52.906Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.907Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-38a7cca3d0220e4c5b7030f2: done: 0.018572 sec","job_status":"done","queue_duration_s":0.485479,"scheduling_latency_s":0.485494,"redis_calls":7,"redis_duration_s":0.0015589999999999998,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018572,"completed_at":"2026-10-03T07:00:53.411Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2039gitlab # [ 250.487498] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"986ed06e2b6f3c81c6fa498f","created_at":"2026-10-03T07:00:52.907Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.908Z","job_size_bytes":6,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-986ed06e2b6f3c81c6fa498f: start","job_status":"start","queue_duration_s":0.503942,"scheduling_latency_s":0.503956}2040gitlab # [ 250.528904] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.422Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"986ed06e2b6f3c81c6fa498f","created_at":"2026-10-03T07:00:52.907Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.908Z","job_size_bytes":6,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-986ed06e2b6f3c81c6fa498f: done: 0.009569 sec","job_status":"done","queue_duration_s":0.503942,"scheduling_latency_s":0.503956,"redis_calls":7,"redis_duration_s":0.001493,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000395,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009569,"completed_at":"2026-10-03T07:00:53.422Z","load_balancing_strategy":"primary","db_duration_s":0.000449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2041gitlab # [ 250.534917] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.423Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3f6b210d28bf5a657014e508","created_at":"2026-10-03T07:00:52.909Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.909Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3f6b210d28bf5a657014e508: start","job_status":"start","queue_duration_s":0.513334,"scheduling_latency_s":0.513347}2042gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses2043gitlab # [ 250.579256] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3f6b210d28bf5a657014e508","created_at":"2026-10-03T07:00:52.909Z","trace_propagation_headers":{"sentry-trace":"9bdd6600c3a94b4baa0e83e0cbf38b53-c9976e984c954f51","baggage":"sentry-trace_id=9bdd6600c3a94b4baa0e83e0cbf38b53,sentry-release=Unknown"},"correlation_id":"01M4091KGS6WD7GGRN1HDYYDEH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:52.909Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3f6b210d28bf5a657014e508: done: 0.016082 sec","job_status":"done","queue_duration_s":0.513334,"scheduling_latency_s":0.513347,"redis_calls":7,"redis_duration_s":0.001508,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016082,"completed_at":"2026-10-03T07:00:53.439Z","load_balancing_strategy":"primary","db_duration_s":0.003462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2044gitlab # [ 250.586418] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.441Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f207e232cfff2d3f70d1b5da","created_at":"2026-10-03T07:00:53.175Z","trace_propagation_headers":{"sentry-trace":"df3d88b391844fc1ace3829e156e4f22-eb86cf0a606e431b","baggage":"sentry-trace_id=df3d88b391844fc1ace3829e156e4f22,sentry-release=Unknown"},"correlation_id":"01M4091KHNXF0FJEYGYKR8K16B","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:53.177Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f207e232cfff2d3f70d1b5da: start","job_status":"start","queue_duration_s":0.264444,"scheduling_latency_s":0.264548}2045gitlab # [ 250.638133] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:53.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f207e232cfff2d3f70d1b5da","created_at":"2026-10-03T07:00:53.175Z","trace_propagation_headers":{"sentry-trace":"df3d88b391844fc1ace3829e156e4f22-eb86cf0a606e431b","baggage":"sentry-trace_id=df3d88b391844fc1ace3829e156e4f22,sentry-release=Unknown"},"correlation_id":"01M4091KHNXF0FJEYGYKR8K16B","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:53.177Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f207e232cfff2d3f70d1b5da: done: 0.049584 sec","job_status":"done","queue_duration_s":0.264444,"scheduling_latency_s":0.264548,"redis_calls":7,"redis_duration_s":0.001891,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001445,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049584,"completed_at":"2026-10-03T07:00:53.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00619,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2046gitlab # [ 250.723828] gitaly[905]: time="2026-10-03T07:00:53.931Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091MYZ03SMT2277G6NV2SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:23.729" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:53.930" grpc.time_ms=0.562 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047gitlab # [ 250.764676] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1162048gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses, in 0.18 seconds)2049gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses2050gitlab # [ 251.902591] gitaly[905]: time="2026-10-03T07:00:55.109Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091P35A9E2A0A06232MCQ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:25.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:55.108" grpc.time_ms=0.976 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 251.964416] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1572052gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses, in 0.20 seconds)2053gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses2054gitlab # [ 253.068551] gitaly[905]: time="2026-10-03T07:00:56.275Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091Q8PY126G6VYAA6NMATS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:26.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:56.274" grpc.time_ms=0.985 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 253.100799] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 932056gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses, in 0.13 seconds)2057gitlab # [ 253.919923] nix-daemon[2812]: accepted connection from pid 3683, user nixbot2058gitlab # [ 253.933307] nix-daemon[2812]: accepted connection from pid 3653, user nixbot2059gitlab # [ 254.032573] gitaly[905]: time="2026-10-03T07:00:57.240Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091R6PB9HSXNYDQ7AR376T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:27.138" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:57.239" grpc.time_ms=0.864 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 254.075188] gitaly[905]: time="2026-10-03T07:00:57.282Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091R6PB9HSXNYDQ7AR376T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:01:07.270" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:57.270" grpc.time_ms=11.584 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses2062gitlab # [ 254.110442] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.317Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"52e235c896c38174c9985e00","created_at":"2026-10-03T07:00:57.312Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-8c3ce2a72c8b4ccf","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.315Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-52e235c896c38174c9985e00: start","job_status":"start","queue_duration_s":0.001567,"scheduling_latency_s":0.001598}2063gitlab # [ 254.145987] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1782064gitlab # [ 254.149223] nixbot[2646]: {"ts": "2026-10-03T07:00:57.355Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f4cbbac2e60157e60cc76ced6ffe55e6880510fe \"HTTP/1.1 201 Created\""}2065gitlab # [ 254.180108] gitaly[905]: time="2026-10-03T07:00:57.387Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091RC4W8MF76P13MAAT6HF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:27.186" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:57.386" grpc.time_ms=0.92 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 254.203913] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 622067gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses, in 0.10 seconds)2068gitlab # [ 254.212797] gitaly[905]: time="2026-10-03T07:00:57.420Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091RCGH68TP60EQ03DRA4X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:27.319" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:57.419" grpc.time_ms=0.463 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 254.235562] gitaly[905]: time="2026-10-03T07:00:57.443Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091R6PB9HSXNYDQ7AR376T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:57.441" grpc.time_ms=1.506 pid=905 span.kind=server system=grpc2070gitlab # [ 254.242615] gitaly[905]: time="2026-10-03T07:00:57.450Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091RCGH68TP60EQ03DRA4X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:01:07.045" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:57.445" grpc.time_ms=4.907 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 254.275978] gitaly[905]: time="2026-10-03T07:00:57.483Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091R6PB9HSXNYDQ7AR376T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:57.483" grpc.time_ms=0.235 pid=905 span.kind=server system=grpc2072gitlab # [ 254.288097] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1352073gitlab # [ 254.291603] nixbot[2646]: {"ts": "2026-10-03T07:00:57.499Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f4cbbac2e60157e60cc76ced6ffe55e6880510fe \"HTTP/1.1 201 Created\""}2074gitlab # [ 254.304519] gitaly[905]: time="2026-10-03T07:00:57.512Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4091R6PB9HSXNYDQ7AR376T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-03T07:00:57.510" grpc.time_ms=0.942 pid=905 span.kind=server system=grpc2075gitlab # [ 254.321059] gitaly[905]: time="2026-10-03T07:00:57.528Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4091R6PB9HSXNYDQ7AR376T diskcache=39b4910f-89d3-4153-9959-0062be7824e1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:27.408" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:57.408" pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 254.330312] gitaly[905]: time="2026-10-03T07:00:57.529Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=93 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7344 command.oublock=0 command.real_time_ms=113 command.spawn_token_fork_ms=0 command.system_time_ms=75 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01M4091R6PB9HSXNYDQ7AR376T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-03T07:01:27.408" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:57.408" grpc.time_ms=120.538 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 254.346429] gitaly[905]: time="2026-10-03T07:00:57.554Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091RH6GCCVB6ESFNAQKN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:27.452" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:57.552" grpc.time_ms=1.133 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 254.379233] gitaly[905]: time="2026-10-03T07:00:57.586Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091RH6GCCVB6ESFNAQKN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-03T07:01:07.179" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-03T07:00:57.579" grpc.time_ms=7.041 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2079gitlab # [ 254.421790] gitaly[905]: time="2026-10-03T07:00:57.629Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091R6PB9HSXNYDQ7AR376T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-03T07:01:27.628" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:57.628" grpc.time_ms=0.614 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab # [ 254.428312] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f4cbbac2e60157e60cc76ced6ffe55e6880510fe HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1252081gitlab # [ 254.429264] nixbot[2646]: {"ts": "2026-10-03T07:00:57.636Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f4cbbac2e60157e60cc76ced6ffe55e6880510fe \"HTTP/1.1 201 Created\""}2082gitlab # [ 254.470104] gitaly[905]: time="2026-10-03T07:00:57.677Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091R6PB9HSXNYDQ7AR376T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-03T07:01:27.676" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-03T07:00:57.677" grpc.time_ms=0.49 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 254.494090] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.701Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f40a53b5de282bb48fbca2f4","created_at":"2026-10-03T07:00:57.697Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"52e235c896c38174c9985e00","job_size_bytes":3,"pid":2520,"job_status":"deduplicated","message":"PipelineProcessWorker JID-f40a53b5de282bb48fbca2f4: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2084gitlab # [ 254.498881] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.706Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"52e235c896c38174c9985e00","created_at":"2026-10-03T07:00:57.312Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-8c3ce2a72c8b4ccf","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.315Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2520,"job_status":"rescheduled","message":"PipelineProcessWorker JID-52e235c896c38174c9985e00: rescheduled"}2085gitlab # [ 254.509293] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.716Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"52e235c896c38174c9985e00","created_at":"2026-10-03T07:00:57.312Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-8c3ce2a72c8b4ccf","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.315Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-52e235c896c38174c9985e00: done: 0.399746 sec","job_status":"done","queue_duration_s":0.001567,"scheduling_latency_s":0.001598,"gitaly_calls":3,"gitaly_duration_s":0.172431,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.048395,"redis_read_bytes":246,"redis_write_bytes":21781,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001357,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001294,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.008036,"redis_queues_read_bytes":35,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.016944,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000196,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002023,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.017188,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.019,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116539,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.352402051,"duration_s":0.399746,"completed_at":"2026-10-03T07:00:57.716Z","load_balancing_strategy":"primary","db_duration_s":0.053494,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2086gitlab # [ 254.553717] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.719Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f27acb183d780d25f6ee19d6","created_at":"2026-10-03T07:00:57.401Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.402Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f27acb183d780d25f6ee19d6: start","job_status":"start","queue_duration_s":0.316282,"scheduling_latency_s":0.316304}2087gitlab # [ 254.571554] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.778Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f27acb183d780d25f6ee19d6","created_at":"2026-10-03T07:00:57.401Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.402Z","job_size_bytes":23,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f27acb183d780d25f6ee19d6: done: 0.059901 sec","job_status":"done","queue_duration_s":0.316282,"scheduling_latency_s":0.316304,"redis_calls":7,"redis_duration_s":0.005158,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004601,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000557,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059901,"completed_at":"2026-10-03T07:00:57.778Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015487,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2088gitlab # [ 254.617615] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0c7906fe44617f1641a0345e","created_at":"2026-10-03T07:00:57.439Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c79d32443f601623d209828449bc5443","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.479Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0c7906fe44617f1641a0345e: start","job_status":"start","queue_duration_s":0.302298,"scheduling_latency_s":0.302318}2089gitlab # [ 254.630028] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0c7906fe44617f1641a0345e","created_at":"2026-10-03T07:00:57.439Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c79d32443f601623d209828449bc5443","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.479Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0c7906fe44617f1641a0345e: done: 0.055864 sec","job_status":"done","queue_duration_s":0.302298,"scheduling_latency_s":0.302318,"redis_calls":13,"redis_duration_s":0.006750000000000001,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001853,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002654,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000578845,"exclusive_lock_hold_duration_s":0.028575419,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.055864,"completed_at":"2026-10-03T07:00:57.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2090gitlab # [ 254.637232] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.839Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"d0b2d0e27b2c9453ac18c644","created_at":"2026-10-03T07:00:57.482Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9351943cd8322acead1e66057f3f4096","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.485Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-d0b2d0e27b2c9453ac18c644: start","job_status":"start","queue_duration_s":0.353825,"scheduling_latency_s":0.353841}2091gitlab # [ 254.656351] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"d0b2d0e27b2c9453ac18c644","created_at":"2026-10-03T07:00:57.482Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9351943cd8322acead1e66057f3f4096","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.485Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-d0b2d0e27b2c9453ac18c644: done: 0.024311 sec","job_status":"done","queue_duration_s":0.353825,"scheduling_latency_s":0.353841,"redis_calls":12,"redis_duration_s":0.005679,"redis_read_bytes":11,"redis_write_bytes":1392,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003015,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001848,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000816,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":206,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000624381,"duration_s":0.024311,"completed_at":"2026-10-03T07:00:57.863Z","load_balancing_strategy":"primary","db_duration_s":0.003337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2092gitlab # [ 254.700914] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.865Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"2849a2f8337dd2bd453e95a5","created_at":"2026-10-03T07:00:57.494Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e018217f8c8a34d4c0572ea5e1c89723","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.498Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-2849a2f8337dd2bd453e95a5: start","job_status":"start","queue_duration_s":0.36685,"scheduling_latency_s":0.366864}2093gitlab # [ 254.755949] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"2849a2f8337dd2bd453e95a5","created_at":"2026-10-03T07:00:57.494Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e018217f8c8a34d4c0572ea5e1c89723","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.498Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-2849a2f8337dd2bd453e95a5: done: 0.097726 sec","job_status":"done","queue_duration_s":0.36685,"scheduling_latency_s":0.366864,"redis_calls":12,"redis_duration_s":0.061791,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.052543,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004079,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000321269,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.097726,"completed_at":"2026-10-03T07:00:57.963Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2094gitlab # [ 254.760940] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:57.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ImportExportProjectCleanupWorker","jid":"f79879a696d7caabac48f186","created_at":"2026-10-03T07:00:57.500Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cfaa27ce611bcb1dcccbd3d98aca498","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c1ab68355154ed2a8f72791841b7337bdce81d68788119e527d7446bb987ef9a","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.503Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ImportExportProjectCleanupWorker JID-f79879a696d7caabac48f186: start","job_status":"start","queue_duration_s":0.464791,"scheduling_latency_s":0.464826}2095gitlab # [ 254.804953] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ImportExportProjectCleanupWorker","jid":"f79879a696d7caabac48f186","created_at":"2026-10-03T07:00:57.500Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cfaa27ce611bcb1dcccbd3d98aca498","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c1ab68355154ed2a8f72791841b7337bdce81d68788119e527d7446bb987ef9a","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.503Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ImportExportProjectCleanupWorker JID-f79879a696d7caabac48f186: done: 0.044173 sec","job_status":"done","queue_duration_s":0.464791,"scheduling_latency_s":0.464826,"redis_calls":12,"redis_duration_s":0.00903,"redis_read_bytes":11,"redis_write_bytes":1420,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002456,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":638,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004605,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000777753,"duration_s":0.044173,"completed_at":"2026-10-03T07:00:58.012Z","load_balancing_strategy":"primary","db_duration_s":0.012339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2096gitlab # [ 254.808568] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"ffd347352953b68173004907","created_at":"2026-10-03T07:00:57.507Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1781f36b9fb6e1a18a39fd0fd2639a6f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.510Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-ffd347352953b68173004907: start","job_status":"start","queue_duration_s":0.50604,"scheduling_latency_s":0.506055}2097gitlab # [ 254.855948] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"ffd347352953b68173004907","created_at":"2026-10-03T07:00:57.507Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1781f36b9fb6e1a18a39fd0fd2639a6f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.510Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-ffd347352953b68173004907: done: 0.047264 sec","job_status":"done","queue_duration_s":0.50604,"scheduling_latency_s":0.506055,"redis_calls":20,"redis_duration_s":0.012089,"redis_read_bytes":23,"redis_write_bytes":4317,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002647,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000646,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2022,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.004768,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001955835,"duration_s":0.047264,"completed_at":"2026-10-03T07:00:58.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 254.863584] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"e274e5d528475eaac494be9a","created_at":"2026-10-03T07:00:57.517Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a25334dd47baded9aa7958f90cd0de5","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.524Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-e274e5d528475eaac494be9a: start","job_status":"start","queue_duration_s":0.541278,"scheduling_latency_s":0.541297}2099gitlab # [ 254.896501] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.104Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"e274e5d528475eaac494be9a","created_at":"2026-10-03T07:00:57.517Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a25334dd47baded9aa7958f90cd0de5","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.524Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-e274e5d528475eaac494be9a: done: 0.038011 sec","job_status":"done","queue_duration_s":0.541278,"scheduling_latency_s":0.541297,"redis_calls":10,"redis_duration_s":0.008977,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000562,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007576,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000839,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005251226,"duration_s":0.038011,"completed_at":"2026-10-03T07:00:58.104Z","load_balancing_strategy":"primary","db_duration_s":0.013462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2100gitlab # [ 254.913578] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.110Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"eb123fef44adda3762dcb890","created_at":"2026-10-03T07:00:57.547Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.551Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-eb123fef44adda3762dcb890: start","job_status":"start","queue_duration_s":0.558991,"scheduling_latency_s":0.559041}2101gitlab # [ 254.966216] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 542102gitlab # [ 254.966900] gitlab-workhorse[823]: time="2026-10-03T07:00:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672103gitlab # [ 254.967563] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 482104gitlab # [ 254.968065] gitaly[905]: time="2026-10-03T07:00:58.113Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091S2BYVTPXSKQVJ9GPK26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=202 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:58.103" grpc.time_ms=10.05 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc2105gitlab # [ 254.968709] gitaly[905]: time="2026-10-03T07:00:58.163Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4091S43W5RPZZDVNQRKMB9C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:58.156" pid=905 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2106gitlab # [ 254.969258] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.148Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"eb123fef44adda3762dcb890","created_at":"2026-10-03T07:00:57.547Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.551Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-eb123fef44adda3762dcb890: done: 0.037694 sec","job_status":"done","queue_duration_s":0.558991,"scheduling_latency_s":0.559041,"redis_calls":7,"redis_duration_s":0.0013440000000000001,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037694,"completed_at":"2026-10-03T07:00:58.148Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2107gitlab # [ 255.017650] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.151Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"cb36c210fa66000f2315aaaf","created_at":"2026-10-03T07:00:57.551Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"398c22b64382d44fe2febd228eb24302","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.567Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-cb36c210fa66000f2315aaaf: start","job_status":"start","queue_duration_s":0.583347,"scheduling_latency_s":0.583362}2108gitlab # [ 255.018464] gitaly[905]: time="2026-10-03T07:00:58.163Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091S43W5RPZZDVNQRKMB9C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:58.156" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc2109gitlab # [ 255.021157] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.219Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"cb36c210fa66000f2315aaaf","created_at":"2026-10-03T07:00:57.551Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"398c22b64382d44fe2febd228eb24302","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.567Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-cb36c210fa66000f2315aaaf: done: 0.068443 sec","job_status":"done","queue_duration_s":0.583347,"scheduling_latency_s":0.583362,"redis_calls":10,"redis_duration_s":0.002837,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000667683,"duration_s":0.068443,"completed_at":"2026-10-03T07:00:58.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2110gitlab # [ 255.072167] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.220Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9906202d6b17208a23da6e28","created_at":"2026-10-03T07:00:57.571Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.573Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9906202d6b17208a23da6e28: start","job_status":"start","queue_duration_s":0.646582,"scheduling_latency_s":0.646596}2111gitlab # [ 255.072903] gitaly[905]: time="2026-10-03T07:00:58.163Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4091S43W5RPZZDVNQRKMB9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:58.156" grpc.time_ms=7.009 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc2112gitlab # [ 255.124742] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 512113gitlab # [ 255.125580] gitlab-workhorse[823]: time="2026-10-03T07:00:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672114gitlab # [ 255.126064] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/10/03:07:00:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 532115gitlab # [ 255.126845] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.269Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9906202d6b17208a23da6e28","created_at":"2026-10-03T07:00:57.571Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.573Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9906202d6b17208a23da6e28: done: 0.04929 sec","job_status":"done","queue_duration_s":0.646582,"scheduling_latency_s":0.646596,"redis_calls":7,"redis_duration_s":0.0012510000000000002,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04929,"completed_at":"2026-10-03T07:00:58.269Z","load_balancing_strategy":"primary","db_duration_s":0.027033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2116gitlab # [ 255.129691] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"bbd224c49a0822cb8b891fac","created_at":"2026-10-03T07:00:57.574Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee2d8c96f1c6ff060e2c3edf0d548326","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.583Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-bbd224c49a0822cb8b891fac: start","job_status":"start","queue_duration_s":0.687738,"scheduling_latency_s":0.687753}2117gitlab # [ 255.176979] gitaly[905]: time="2026-10-03T07:00:58.244Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4091S6HYXQ6AARR44WZ99CF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:58.232" grpc.time_ms=12.238 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc2118gitlab # [ 255.177635] gitaly[905]: time="2026-10-03T07:00:58.300Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4091S87HBSPNNG599P064YJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:58.288" pid=905 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2119gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses2120gitlab # [ 255.178493] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"bbd224c49a0822cb8b891fac","created_at":"2026-10-03T07:00:57.574Z","trace_propagation_headers":{"sentry-trace":"350e38d03a494c54a2fe66e9888a4541-51350e5d23ec4592","baggage":"sentry-trace_id=350e38d03a494c54a2fe66e9888a4541,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee2d8c96f1c6ff060e2c3edf0d548326","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.583Z","job_size_bytes":2,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-bbd224c49a0822cb8b891fac: done: 0.01622 sec","job_status":"done","queue_duration_s":0.687738,"scheduling_latency_s":0.687753,"redis_calls":10,"redis_duration_s":0.001909,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000302552,"duration_s":0.01622,"completed_at":"2026-10-03T07:00:58.286Z","load_balancing_strategy":"primary","db_duration_s":0.000264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2121gitlab # [ 255.231623] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.292Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"c75c34a67c377fa4efbfeaba","created_at":"2026-10-03T07:00:57.581Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.585Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-c75c34a67c377fa4efbfeaba: start","job_status":"start","queue_duration_s":0.707229,"scheduling_latency_s":0.707243}2122gitlab # [ 255.232227] gitaly[905]: time="2026-10-03T07:00:58.300Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4091S87HBSPNNG599P064YJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:58.288" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc2123gitlab # [ 255.232717] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.317Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"c75c34a67c377fa4efbfeaba","created_at":"2026-10-03T07:00:57.581Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.585Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-c75c34a67c377fa4efbfeaba: done: 0.024964 sec","job_status":"done","queue_duration_s":0.707229,"scheduling_latency_s":0.707243,"redis_calls":10,"redis_duration_s":0.003764,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001295,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024964,"completed_at":"2026-10-03T07:00:58.317Z","load_balancing_strategy":"primary","db_duration_s":0.004411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 255.287575] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.318Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"718d33b5009f8f817a4d07c9","created_at":"2026-10-03T07:00:57.586Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.590Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-718d33b5009f8f817a4d07c9: start","job_status":"start","queue_duration_s":0.728163,"scheduling_latency_s":0.728177}2125gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f4cbbac2e60157e60cc76ced6ffe55e6880510fe/statuses, in 0.12 seconds)2126(finished: subtest: eval and build post commit statuses, in 5.97 seconds)2127(finished: run the VM test script, in 304.96 seconds)2128gitlab # [ 255.288518] gitaly[905]: time="2026-10-03T07:00:58.300Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4091S87HBSPNNG599P064YJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-03T07:00:58.288" grpc.time_ms=12.107 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=905 remote_ip="2001:db8:1::1" span.kind=server system=grpc2129test script finished in 304.99s2130cleanup2131kill QemuMachine (pid 46)2132gitlab # [ 255.294314] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-10-03T07:00:58.335Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"718d33b5009f8f817a4d07c9","created_at":"2026-10-03T07:00:57.586Z","trace_propagation_headers":{"sentry-trace":"67584aaeb116476a9174eb0193872156-f70ad09ff545469d","baggage":"sentry-trace_id=67584aaeb116476a9174eb0193872156,sentry-release=Unknown"},"correlation_id":"01M4091R6PB9HSXNYDQ7AR376T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-03T07:00:57.590Z","job_size_bytes":3,"pid":2520,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-718d33b5009f8f817a4d07c9: done: 0.016805 sec","job_status":"done","queue_duration_s":0.728163,"scheduling_latency_s":0.728177,"redis_calls":7,"redis_duration_s":0.001293,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2133(finished: cleanup, in 1.57 seconds)2134additionally exposed symbols:2135 gitlab,2136 vlan1,2137 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2138[]2139[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-03T07:00:03.918Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2140[]2141[]2142[]2143[]2144[]2145[]2146[]2147[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'f4cbbac2e60157e60cc76ced6ffe55e6880510fe', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-03T07:00:52.398351Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2148[{'id': 5, 'sha': 'f4cbbac2e60157e60cc76ced6ffe55e6880510fe', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-03T07:00:52.739Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2149[{'id': 5, 'sha': 'f4cbbac2e60157e60cc76ced6ffe55e6880510fe', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-03T07:00:52.739Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2150[{'id': 5, 'sha': 'f4cbbac2e60157e60cc76ced6ffe55e6880510fe', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-03T07:00:52.739Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2151[{'id': 5, 'sha': 'f4cbbac2e60157e60cc76ced6ffe55e6880510fe', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-03T07:00:52.739Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2152[{'id': 5, 'sha': 'f4cbbac2e60157e60cc76ced6ffe55e6880510fe', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-03T07:00:52.739Z', 'started_at': None, 'finished_at': '2026-10-03T07:00:57.304Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2153[{'id': 5, 'sha': 'f4cbbac2e60157e60cc76ced6ffe55e6880510fe', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-03T07:00:52.739Z', 'started_at': None, 'finished_at': '2026-10-03T07:00:57.304Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'f4cbbac2e60157e60cc76ced6ffe55e6880510fe', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-03T07:00:57.479Z', 'started_at': None, 'finished_at': '2026-10-03T07:00:57.616Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]