vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #458
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11(finished: start all VMs, in 48.47 seconds)12gitlab # Formatting '/build/vm-state-gitlab/tmp.izdDDVwaPn', fmt=raw size=107374182413gitlab: waiting for unit setup-gitlab.service14gitlab # mke2fs 1.47.4 (6-Mar-2025)15gitlab: waiting for the VM to finish booting16gitlab # Discarding device blocks: 0/262144 done17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: 38f857ed-852a-4846-aa05-d90a09f2c5e319gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wz5kpm29iv16v3j21cjfbmzbj9is6v45-nixos-system-gitlab-test/init regInfo=/nix/store/wl2r0hmxl04rd9qqhbgk34m16g0hlccz-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 490707376 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000810] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000877] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002736] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002747] Using GB pages for direct mapping73gitlab # [ 0.002826] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002833] ACPI: Early table checksum verification disabled75gitlab # [ 0.002835] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002839] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002843] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002849] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002851] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002853] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002854] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002856] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002857] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002858] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002859] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002860] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002860] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002861] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003085] No NUMA configuration found90gitlab # [ 0.003086] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003088] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005350] Zone ranges:93gitlab # [ 0.005351] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005352] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005353] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005354] Device empty97gitlab # [ 0.005355] Movable zone start for each node98gitlab # [ 0.005355] Early memory node ranges99gitlab # [ 0.005356] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005357] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005358] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005359] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005379] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005658] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.113007] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.113426] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.113441] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.113480] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.113483] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.113485] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.113486] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.113487] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.113487] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.113490] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.113491] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.113496] TSC deadline timer available117gitlab # [ 0.113500] CPU topo: Max. logical packages: 1118gitlab # [ 0.113501] CPU topo: Max. logical dies: 1119gitlab # [ 0.113501] CPU topo: Max. dies per package: 1120gitlab # [ 0.113505] CPU topo: Max. threads per core: 1121gitlab # [ 0.113505] CPU topo: Num. cores per package: 4122gitlab # [ 0.113506] CPU topo: Num. threads per package: 4123gitlab # [ 0.113506] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.113530] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.113547] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.113550] kvm-guest: setup PV sched yield127gitlab # [ 0.113565] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.113567] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.113568] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.113569] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.113571] Booting paravirtualized kernel on KVM132gitlab # [ 0.113574] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.118027] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.120158] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.120207] kvm-guest: PV spinlocks enabled136gitlab # [ 0.120209] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.120211] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wz5kpm29iv16v3j21cjfbmzbj9is6v45-nixos-system-gitlab-test/init regInfo=/nix/store/wl2r0hmxl04rd9qqhbgk34m16g0hlccz-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.120306] Unknown kernel command line parameters "regInfo=/nix/store/wl2r0hmxl04rd9qqhbgk34m16g0hlccz-closure-info/registration", will be passed to user space.139gitlab # [ 0.120319] random: crng init done140gitlab # [ 0.120320] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.128695] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.132962] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.133035] software IO TLB: area num 4.144gitlab # [ 0.203046] Fallback order for Node 0: 0145gitlab # [ 0.203054] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.203056] Policy zone: Normal147gitlab # [ 0.205468] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.214859] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.227789] allocated 12582912 bytes of page_ext150gitlab # [ 0.237675] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.237676] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.238509] Dynamic Preempt: lazy153gitlab # [ 0.238693] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.238694] rcu: RCU event tracing is enabled.155gitlab # [ 0.238695] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.238696] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.238697] Rude variant of Tasks RCU enabled.158gitlab # [ 0.238697] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.238698] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.238698] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.238723] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.238724] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.238725] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.243040] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.243322] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.243330] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.243429] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.246978] Console: colour VGA+ 80x25169gitlab # [ 0.246981] printk: legacy console [tty0] enabled170gitlab # [ 0.277874] printk: legacy console [ttyS0] enabled171gitlab # [ 0.384630] ACPI: Core revision 20250807172gitlab # [ 0.385579] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.387160] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.388213] x2apic enabled175gitlab # [ 0.388967] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.389934] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.391166] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.392745] kvm-guest: setup PV IPIs179gitlab # [ 0.394353] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.395450] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.397326] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.398411] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.400392] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.402324] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.403327] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.405324] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.407325] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.408324] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.409324] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.410324] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.411331] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.412083] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.413325] active return thunk: srso_alias_return_thunk194gitlab # [ 0.414345] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.415324] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.416324] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.417324] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.418324] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.419324] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.420324] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.422284] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.423324] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.424324] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.425324] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.426324] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.427303] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.456988] Freeing SMP alternatives memory: 44K208gitlab # [ 0.457327] pid_max: default: 32768 minimum: 301209gitlab # [ 0.458418] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.459431] landlock: Up and running.211gitlab # [ 0.460084] Yama: becoming mindful.212gitlab # [ 0.461408] LSM support for eBPF active213gitlab # [ 0.462279] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.463466] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.466126] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.466859] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.467329] ... version: 2218gitlab # [ 0.468046] ... bit width: 48219gitlab # [ 0.468327] ... generic counters: 6220gitlab # [ 0.469055] ... generic bitmap: 000000000000003f221gitlab # [ 0.469338] ... fixed-purpose counters: 0222gitlab # [ 0.470050] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.470326] ... value mask: 0000ffffffffffff224gitlab # [ 0.471290] ... max period: 00007fffffffffff225gitlab # [ 0.472139] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.473248] signal: max sigframe size: 3376227gitlab # [ 0.473972] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.474330] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.475465] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.480918] smp: Bringing up secondary CPUs ...231gitlab # [ 0.481748] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.482329] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.485459] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.487115] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.488632] Memory: 6011368K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.490326] devtmpfs: initialized237gitlab # [ 0.491383] x86/mm: Memory block size: 128MB238gitlab # [ 0.494501] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.495406] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.496421] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.497576] PM: RTC time: 17:22:41, date: 2026-10-17242gitlab # [ 0.501279] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.503490] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.504380] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.506372] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.507338] audit: initializing netlink subsys (disabled)247gitlab # [ 0.508389] audit: type=2000 audit(1792257761.623:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.508569] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.510327] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.511326] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.512326] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.513326] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.514341] cpuidle: using governor menu254gitlab # [ 0.516527] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.517581] PCI: Using configuration type 1 for base access256gitlab # [ 0.518327] PCI: Using configuration type 1 for extended access257gitlab # [ 0.519455] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.522377] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.523327] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.524327] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.525326] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.530305] ACPI: Added _OSI(Module Device)263gitlab # [ 0.532333] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.534345] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.541276] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.547582] ACPI: Interpreter enabled267gitlab # [ 0.548808] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.549334] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.551441] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.554335] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.557984] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.571629] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.573387] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.578153] acpiphp: Slot [3] registered275gitlab # [ 0.580384] acpiphp: Slot [4] registered276gitlab # [ 0.581370] acpiphp: Slot [5] registered277gitlab # [ 0.583371] acpiphp: Slot [6] registered278gitlab # [ 0.584387] acpiphp: Slot [7] registered279gitlab # [ 0.585372] acpiphp: Slot [8] registered280gitlab # [ 0.587372] acpiphp: Slot [9] registered281gitlab # [ 0.588370] acpiphp: Slot [10] registered282gitlab # [ 0.590387] acpiphp: Slot [11] registered283gitlab # [ 0.591374] acpiphp: Slot [12] registered284gitlab # [ 0.592370] acpiphp: Slot [13] registered285gitlab # [ 0.594377] acpiphp: Slot [14] registered286gitlab # [ 0.595387] acpiphp: Slot [15] registered287gitlab # [ 0.597371] acpiphp: Slot [16] registered288gitlab # [ 0.598369] acpiphp: Slot [17] registered289gitlab # [ 0.600386] acpiphp: Slot [18] registered290gitlab # [ 0.601288] acpiphp: Slot [19] registered291gitlab # [ 0.601855] acpiphp: Slot [20] registered292gitlab # [ 0.602347] acpiphp: Slot [21] registered293gitlab # [ 0.603151] acpiphp: Slot [22] registered294gitlab # [ 0.603938] acpiphp: Slot [23] registered295gitlab # [ 0.604347] acpiphp: Slot [24] registered296gitlab # [ 0.605115] acpiphp: Slot [25] registered297gitlab # [ 0.606355] acpiphp: Slot [26] registered298gitlab # [ 0.607149] acpiphp: Slot [27] registered299gitlab # [ 0.607924] acpiphp: Slot [28] registered300gitlab # [ 0.608346] acpiphp: Slot [29] registered301gitlab # [ 0.609145] acpiphp: Slot [30] registered302gitlab # [ 0.609929] acpiphp: Slot [31] registered303gitlab # [ 0.611358] PCI host bridge to bus 0000:00304gitlab # [ 0.612123] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.613275] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.614274] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.615326] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.617365] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.618354] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.619779] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.622014] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.623808] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.627384] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.628354] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.629327] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.630327] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.631327] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.632512] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.635380] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.638376] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.639626] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.641333] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.642573] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.655410] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.657340] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.658348] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.659526] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.661080] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.666336] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.668334] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.669349] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.682335] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.684913] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.694366] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.696350] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.699388] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.706999] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.716369] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.718348] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.721387] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.727413] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.735348] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.737348] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.740386] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.746084] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.752380] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.753344] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.755350] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.757914] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.763358] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.764327] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.765350] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.768630] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.772358] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.773326] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.774348] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.776333] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.778552] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.781365] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.782370] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.784560] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.788366] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.789333] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.790349] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.792644] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.797359] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.798326] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.799348] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.804044] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.805479] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.807475] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.808459] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.809403] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.812502] iommu: Default domain type: Translated375gitlab # [ 0.813329] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.814579] ACPI: bus type USB registered377gitlab # [ 0.815378] usbcore: registered new interface driver usbfs378gitlab # [ 0.816364] usbcore: registered new interface driver hub379gitlab # [ 0.817350] usbcore: registered new device driver usb380gitlab # [ 0.820096] NetLabel: Initializing381gitlab # [ 0.820171] NetLabel: domain hash size = 128382gitlab # [ 0.820931] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.822430] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.823337] PCI: Using ACPI for IRQ routing385gitlab # [ 0.824531] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.825323] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.825323] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.828331] vgaarb: loaded389gitlab # [ 0.829105] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.830327] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.834623] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.836575] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.838417] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.841969] pnp: PnP ACPI init395gitlab # [ 0.844966] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.860750] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.864643] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.867202] NET: Registered PF_INET protocol family399gitlab # [ 0.872297] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.900237] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.901800] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.903278] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.907071] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.908473] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.909722] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.911127] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.912639] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.914077] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.915157] NET: Registered PF_XDP protocol family410gitlab # [ 0.916052] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.917170] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.918264] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.919473] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.920717] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.922215] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.923299] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.925866] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.928793] PCI: CLS 0 bytes, default 64419gitlab # [ 0.929694] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.930441] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.930846] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.933800] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.954637] Initialise system trusted keyrings424gitlab # [ 0.955843] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.967282] Key type asymmetric registered426gitlab # [ 0.968189] Asymmetric key parser 'x509' registered427gitlab # [ 0.969148] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.970867] io scheduler mq-deadline registered429gitlab # [ 0.971755] io scheduler kyber registered430gitlab # [ 0.975638] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.977068] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.979450] Linux agpgart interface v0.103433gitlab # [ 0.980288] ACPI: bus type drm_connector registered434gitlab # [ 0.982710] usbcore: registered new interface driver usbserial_generic435gitlab # [ 0.983877] usbserial: USB Serial support registered for generic436gitlab # [ 0.984978] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 0.984978] Please enable it if your BIOS has the CPPC option.438gitlab # [ 0.987439] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 0.988952] drop_monitor: Initializing network drop monitor service440gitlab # [ 0.990256] NET: Registered PF_INET6 protocol family441gitlab # [ 0.992192] Segment Routing with IPv6442gitlab # [ 0.992893] In-situ OAM (IOAM) with IPv6443gitlab # [ 0.995511] IPI shorthand broadcast: enabled444gitlab # [ 1.000053] sched_clock: Marking stable (854011915, 145993872)->(1021890378, -21884591)445gitlab # [ 1.002048] registered taskstats version 1446gitlab # [ 1.003136] Loading compiled-in X.509 certificates447gitlab # [ 1.012655] Demotion targets for Node 0: null448gitlab # [ 1.013786] Key type .fscrypt registered449gitlab # [ 1.014567] Key type fscrypt-provisioning registered450gitlab # [ 1.015637] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.016665] ima: Allocated hash algorithm: sha1452gitlab # [ 1.017550] ima: No architecture policies found453gitlab # [ 1.018677] PM: Magic number: 14:927:390454gitlab # [ 1.020404] RAS: Correctable Errors collector initialized.455gitlab # [ 1.024945] clk: Disabling unused clocks456gitlab # [ 1.025730] PM: genpd: Disabling unused power domains457gitlab # [ 1.221497] Freeing initrd memory: 29392K458gitlab # [ 1.229503] Freeing unused decrypted memory: 2028K459gitlab # [ 1.236271] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.239208] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.244239] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.248202] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.316876] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.318158] Run /init as init process465gitlab # [ 1.330343] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.352534] fuse: init (API version 7.45)467gitlab # [ 1.360684] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.367572] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.370743] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.416118] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.752861] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.794479] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.796760] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.799049] systemd[1]: Running in initrd.475gitlab # [ 1.801575] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.804779] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.917236] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.957917] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.967678] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.968963] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.970494] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.971778] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.972968] systemd[1]: Reached target Path Units.484gitlab # [ 1.973940] systemd[1]: Reached target Slice Units.485gitlab # [ 1.974949] systemd[1]: Reached target Swaps.486gitlab # [ 1.975836] systemd[1]: Reached target Timer Units.487gitlab # [ 1.976897] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.978243] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.979531] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.980638] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.981797] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.982832] systemd[1]: Reached target Socket Units.493gitlab # [ 1.984815] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.987062] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.989199] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 1.992067] systemd[1]: Starting Journal Service...497gitlab # [ 1.996082] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 1.997968] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.005116] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.009670] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.014325] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.016233] systemd-journald[91]: Collecting audit messages is disabled.503gitlab # [ 2.023611] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 2.030116] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.051570] netfs: FS-Cache loaded506gitlab # [ 2.053098] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...507gitlab # [ 2.058301] 9pnet: Installing 9P2000 support508gitlab # [ 2.062122] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.509gitlab # [ 2.070669] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.510gitlab # [ 2.072790] systemd[1]: Finished Load Kernel Module 9pnet_virtio.511gitlab # [ 2.074375] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev512gitlab # [ 2.076135] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.513gitlab # [ 2.078674] systemd[1]: Finished Load Kernel Modules.514gitlab # [ 2.081271] systemd[1]: Starting Apply Kernel Variables...515gitlab # [ 2.083327] systemd[1]: Starting Create Static Device Nodes in /dev...516gitlab # [ 2.092741] systemd[1]: Started Journal Service.517gitlab # [ 1.946832] systemd-modules-load[92]: Using 4 probe threads518gitlab # [ 1.948753] systemd-modules-load[92]: Inserted module 'virtio_gpu'519gitlab # [ 1.949815] systemd-modules-load[92]: Inserted module 'virtio_balloon'520gitlab # [ 1.950962] systemd-modules-load[92]: Inserted module 'dm_mod'521gitlab # [ 1.951926] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 1.952981] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.954133] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.955193] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.956196] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.957264] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.971255] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.978982] systemd-udevd[110]: Using default interface naming scheme 'v261'.529gitlab # [ 1.990272] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.011040] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.012179] systemd[1]: Reached target System Initialization.532gitlab # [ 2.013116] systemd[1]: Reached target Basic System.533gitlab # [ 2.255904] SCSI subsystem initialized534gitlab # [ 2.258275] virtio_blk virtio4: 4/0/0 default/read/poll queues535gitlab # [ 2.267472] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)536gitlab # [ 2.279357] uhci_hcd 0000:00:01.2: UHCI Host Controller537gitlab # [ 2.282104] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1538gitlab # [ 2.283388] uhci_hcd 0000:00:01.2: detected 2 ports539gitlab # [ 2.284296] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140540gitlab # [ 2.287259] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18541gitlab # [ 2.288983] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1542gitlab # [ 2.290412] usb usb1: Product: UHCI Host Controller543gitlab # [ 2.291130] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd544gitlab # [ 2.291883] usb usb1: SerialNumber: 0000:00:01.2545gitlab # [ 2.294981] virtio_blk virtio5: 4/0/0 default/read/poll queues546gitlab # [ 2.296677] hub 1-0:1.0: USB hub found547gitlab # [ 2.297076] scsi host0: ata_piix548gitlab # [ 2.297202] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12549gitlab # [ 2.297448] hub 1-0:1.0: 2 ports detected550gitlab # [ 2.300884] scsi host1: ata_piix551gitlab # [ 2.301411] serio: i8042 KBD port at 0x60,0x64 irq 1552gitlab # [ 2.302726] serio: i8042 AUX port at 0x60,0x64 irq 12553gitlab # [ 2.303670] virtio_blk virtio5: [vdb] 11953256 512-byte logical blocks (6.12 GB/5.70 GiB)554gitlab # [ 2.312188] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.314610] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.186887] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.189389] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 2.193857] (udev-worker)[118]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.559gitlab # [ 2.199088] (udev-worker)[118]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.206950] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.208278] systemd[1]: Reached target Initrd Root Device.562gitlab # [ 2.209212] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...563gitlab # [ 2.211780] systemd-vconsole-setup[149]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 2.227199] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 2.230220] systemd[1]: Found device /dev/disk/by-label/nix-store.566gitlab # [ 2.241091] systemd-fsck[156]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.244629] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.478338] ata2: found unknown device (class 0)569gitlab # [ 2.481134] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100570gitlab # [ 2.485210] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5571gitlab # [ 2.506513] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0572gitlab # [ 2.518096] usb 1-1: new full-speed USB device number 2 using uhci_hcd573gitlab # [ 2.543165] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.574728] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.684560] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.687672] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.690411] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.692085] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.693604] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.710700] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.718468] usbcore: registered new interface driver usbhid582gitlab # [ 2.719378] usbhid: USB HID core driver583gitlab # [ 2.724468] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.726368] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.863557] systemd[1]: Mounting /sysroot...586gitlab # [ 3.134849] EXT4-fs (vda): mounted filesystem 38f857ed-852a-4846-aa05-d90a09f2c5e3 r/w with ordered data mode. Quota mode: none.587gitlab # [ 2.995085] systemd[1]: Mounted /sysroot.588gitlab # [ 2.996719] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 2.998837] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.002298] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.004226] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.005821] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.007531] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.009337] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.017799] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.019559] systemd[1]: Starting rw-sysroot-nix-store.service...597gitlab # [ 3.027275] systemd-sysroot-fstab-check[176]: /sysroot should be mounted in the initrd, will request daemon-reload.598gitlab # [ 3.030345] systemd[1]: Mounted /sysroot/run.599gitlab # [ 3.032693] systemd[1]: Reload requested from client PID 176 ('systemd-sysroot') (unit initrd-parse-etc.service)...600gitlab # [ 3.035376] systemd[1]: Reloading...601gitlab # [ 3.184778] erofs (device vdb): mounted with root inode @ nid 128.602gitlab # [ 3.187237] 9p: Installing v9fs 9p2000 file system support603gitlab # [ 3.096202] systemd[1]: Reloading finished in 62 ms.604gitlab # [ 3.122846] systemd-sysroot-fstab-check[176]: Requesting initrd-fs.target/start/replace...605gitlab # [ 3.125722] systemd[1]: Mounted /sysroot/nix/.ro-store.606gitlab # [ 3.127530] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.129271] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.131065] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.133579] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.135549] systemd-sysroot-fstab-check[176]: Requesting swap.target/start/replace...611gitlab # [ 3.138054] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.140168] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.142801] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.145137] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.147638] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.149955] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.865149] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.910768] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.912779] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.914761] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.916791] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.940681] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.943324] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.959853] systemd[1]: Finished Find NixOS closure.625gitlab # [ 3.961624] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 3.963897] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 3.993252] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 3.995593] systemd[1]: Stopped target Basic System.629gitlab # [ 3.997348] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 3.999259] systemd[1]: Stopped target Path Units.631gitlab # [ 4.000940] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.003424] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.005957] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.007724] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.009435] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.011311] systemd[1]: Stopped target Swaps.637gitlab # [ 4.012877] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.014548] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.016476] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.018488] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.021067] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.023072] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.026826] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.030275] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.032196] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.034215] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.036132] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.037539] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.039570] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.041568] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.043451] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.045138] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.046654] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.048441] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.050210] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.051557] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.052654] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.053682] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.054357] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.055253] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.056108] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.057083] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.058544] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.059519] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.060574] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.061614] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.062411] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.063385] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.064695] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.065743] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.066988] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.068234] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.069333] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.092224] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.093465] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.094686] systemd[1]: Reached target Switch Root.677gitlab # [ 4.096186] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.202820] initrd-nixos-activation-start[226]: booting system configuration /nix/store/wz5kpm29iv16v3j21cjfbmzbj9is6v45-nixos-system-gitlab-test679gitlab # [ 4.246319] initrd-nixos-activation-start[226]: running activation script...680gitlab # [ 4.448132] initrd-nixos-activation-start[249]: setting up /etc...681gitlab # [ 4.517392] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.520156] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.521993] systemd[1]: Starting Switch Root...684gitlab # [ 4.558431] systemd[1]: Switching root.685gitlab # [ 4.755530] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.837051] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.213918] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.224183] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.226065] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.228054] systemd[1]: Detected first boot.691gitlab # [ 5.230493] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.366750] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.430153] systemd[1]: Applying preset policy.694gitlab # [ 5.548265] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.657267] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.658623] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.660743] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.663134] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.664458] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.665914] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.666911] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.668135] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.669216] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.669927] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.670709] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.671551] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.672335] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.673161] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.674026] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.674960] systemd[1]: Reached target Path Units.711gitlab # [ 5.675760] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.676597] systemd[1]: Reached target Slice Units.713gitlab # [ 5.677327] systemd[1]: Reached target Swaps.714gitlab # [ 5.678738] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.680683] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.682098] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.683693] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.684629] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.686937] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.688365] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.690271] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.691454] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.692592] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.694014] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.696616] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.697664] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.698545] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.700854] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.702736] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.708888] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.710743] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.714265] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.715316] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.718959] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.719923] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.721352] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.722876] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.737843] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.738754] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.742630] systemd[1]: Starting Journal Service...741gitlab # [ 5.744757] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.746909] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.749077] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.750034] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 5.756930] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 5.763396] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 5.766358] systemd[1]: Mounted Huge Pages File System.748gitlab # [ 5.768555] systemd[1]: Mounted POSIX Message Queue File System.749gitlab # [ 5.770862] systemd[1]: Mounted Kernel Debug File System.750gitlab # [ 5.772751] systemd[1]: Mounted Kernel Trace File System.751gitlab # [ 5.776151] systemd[1]: Finished Create List of Static Device Nodes.752gitlab # [ 5.777108] EXT4-fs (vda): re-mounted 38f857ed-852a-4846-aa05-d90a09f2c5e3.753gitlab # [ 5.780837] systemd[1]: modprobe@configfs.service: Deactivated successfully.754gitlab # [ 5.780922] systemd-journald[320]: Collecting audit messages is enabled.755gitlab # [ 5.782179] systemd[1]: Finished Load Kernel Module configfs.756gitlab # [ 5.787269] systemd[1]: Mounted FUSE Control File System.757gitlab # [ 5.789345] systemd[1]: Finished Remount Root and Kernel File Systems.758gitlab # [ 5.790894] systemd[1]: Listening on Disk Image Download Service Socket.759gitlab # [ 5.793109] systemd[1]: Mounting Kernel Configuration File System...760gitlab # [ 5.795060] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore761gitlab # [ 5.650940] systemd[1]: Queued start job for default target Multi-User System.762gitlab # [ 5.652932] systemd[1]: Unnecessary job was removed for /dev/vdb.763gitlab # [ 5.654615] systemd[1]: systemd-journald.service: Deactivated successfully.764gitlab # [ 5.801630] loop: module loaded765gitlab # [ 5.657490] systemd-modules-load[321]: Using 3 probe threads[ 5.803927] systemd[1]: Starting Load/Save OS Random Seed...766gitlab # 767gitlab # [ 5.659398] systemd-modules-load[321]: Inserted module 'tls'768gitlab # [ 5.806054] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...769gitlab # [ 5.807148] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os770gitlab # [ 5.662672] systemd-modules-load[321]: Inserted module 'loop'771gitlab # [ 5.809188] systemd[1]: Started Journal Service.772gitlab # [ 5.667069] systemd[1]: Finished Load Kernel Modules.773gitlab # [ 5.668085] systemd-oomd[322]: No swap; memory pressure usage will be degraded774gitlab # [ 5.669497] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.775gitlab # [ 5.670616] systemd[1]: Mounted Kernel Configuration File System.776gitlab # [ 5.675069] systemd[1]: Starting Firewall...777gitlab # [ 5.676185] systemd[1]: Starting Flush Journal to Persistent Storage...778gitlab # [ 5.678145] systemd[1]: Starting Apply Kernel Variables...779gitlab # [ 5.686847] systemd[1]: Finished Load/Save OS Random Seed.780gitlab # [ 5.689077] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 5.690186] systemd[1]: Reached target First Boot Complete.782gitlab # [ 5.837890] systemd-journald[320]: Received client request to flush runtime journal.783gitlab # [ 5.727255] systemd[1]: Starting Create Static Device Nodes in /dev...784gitlab # [ 5.728688] systemd[1]: Finished Apply Kernel Variables.785gitlab # [ 5.730074] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 5.731306] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 5.732220] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 5.733282] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 5.735089] systemd-udevd[355]: Using default interface naming scheme 'v261'.790gitlab # [ 5.759912] systemd[1]: Started Rule-based Manager for Device Events and Files.791gitlab # [ 5.763569] systemd[1]: Finished Coldplug All udev Devices.792gitlab # [ 5.827847] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 5.844432] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 5.847109] (udev-worker)[423]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 5.852764] (udev-worker)[415]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.796gitlab # [ 5.854751] (udev-worker)[415]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 5.861622] systemd[1]: Condition check resulted in Virtio network device being skipped.798gitlab # [ 5.866485] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.799gitlab # [ 5.868169] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 5.869716] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 5.872119] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 5.873716] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 5.875200] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.069211] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3805gitlab # [ 6.072857] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console806gitlab # [ 6.078962] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0807gitlab # [ 6.080781] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD808gitlab # [ 6.088394] Console: switching to colour dummy device 80x25809gitlab # [ 6.090639] [drm] Found bochs VGA, ID 0xb0c5.810gitlab # [ 6.090642] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.811gitlab # [ 6.101187] ACPI: button: Power Button [PWRF]812gitlab # [ 6.102438] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic813gitlab # [ 6.103212] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0814gitlab # [ 6.108300] rtc_cmos 00:05: RTC can wake from S4815gitlab # [ 6.112899] rtc_cmos 00:05: registered as rtc0816gitlab # [ 6.113596] rtc_cmos 00:05: setting system clock to 2026-10-17T17:22:46 UTC (1792257766)817gitlab # [ 6.116311] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs818gitlab # [ 6.120351] parport_pc 00:03: reported by Plug and Play ACPI819gitlab # [ 6.120433] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]820gitlab # [ 6.128588] Console: switching to colour frame buffer device 160x50821gitlab # [ 6.131243] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device822gitlab # [ 6.132907] Floppy drive(s): fd0 is 2.88M AMI BIOS823gitlab # [ 6.133691] systemd-journald[320]: Time jumped backwards, rotating.824gitlab # [ 6.146476] FDC 0 is a S82078B825gitlab # [ 6.151172] mousedev: PS/2 mouse device common for all mice826gitlab # [ 6.153790] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6827gitlab # [ 6.009412] systemd[1]: Finished Firewall.828gitlab # [ 6.158478] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5829gitlab # [ 6.160578] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4830gitlab # [ 6.068075] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.075774] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.077115] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.079362] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.232483] ppdev: user-space parallel port driver835gitlab # [ 6.093318] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.836gitlab # [ 6.094608] systemd[1]: Stopped Virtual Console Setup.837gitlab # [ 6.098220] systemd[1]: Starting Virtual Console Setup...838gitlab # [ 6.314742] kvm_amd: TSC scaling supported839gitlab # [ 6.315278] kvm_amd: Nested Virtualization enabled840gitlab # [ 6.315754] kvm_amd: Nested Paging enabled841gitlab # [ 6.316223] kvm_amd: LBR virtualization supported842gitlab # [ 6.316733] kvm_amd: Virtual VMLOAD VMSAVE supported843gitlab # [ 6.317613] kvm_amd: Virtual GIF supported844gitlab # [ 6.171625] systemd-vconsole-[ 6.318287] kvm_amd: Virtual NMI enabled845gitlab # setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones.846gitlab # [ 6.174388] systemd[1]: Finished Virtual Console Setup.847gitlab # [ 6.348548] EDAC MC: Ver: 3.0.0848gitlab # [ 6.515858] systemd[1]: Mounting /run/wrappers...849gitlab # [ 6.537974] systemd[1]: Mounted /run/wrappers.850gitlab # [ 6.539888] systemd[1]: Reached target Local File Systems.851gitlab # [ 6.542069] systemd[1]: Listening on Boot Loader Control Service Socket.852gitlab # [ 6.544623] systemd[1]: Starting register-nix-paths.service...853gitlab # [ 6.546939] systemd[1]: Starting Create SUID/SGID Wrappers...854gitlab # [ 6.549232] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.855gitlab # [ 6.552465] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 6.557627] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 6.586538] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.858gitlab # [ 6.590741] systemd[1]: Finished Save Transient machine-id to Disk.859gitlab # [ 6.605957] systemd[1]: Finished Create System Files and Directories.860gitlab # [ 6.609237] systemd[1]: Starting Rebuild Journal Catalog...861gitlab # [ 6.611989] systemd[1]: Starting Record System Boot/Shutdown in UTMP...862gitlab # [ 6.627072] systemd[1]: Finished Record System Boot/Shutdown in UTMP.863gitlab # [ 6.640506] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 6.641713] systemd[1]: Starting Update is Completed...865gitlab # [ 6.657367] systemd[1]: Finished Update is Completed.866gitlab # [ 6.683828] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 6.685287] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 6.901787] systemd[1]: Finished register-nix-paths.service.869gitlab # [ 6.904984] systemd[1]: Reached target System Initialization.870gitlab # [ 6.907559] systemd[1]: Started Discard unused filesystem blocks once a week.871gitlab # [ 6.910244] systemd[1]: Started logrotate.timer.872gitlab # [ 6.911931] systemd[1]: Started Daily Cleanup of Temporary Directories.873gitlab # [ 6.914246] systemd[1]: Reached target Timer Units.874gitlab # [ 6.916060] systemd[1]: Listening on D-Bus System Message Bus Socket.875gitlab # [ 6.918303] systemd[1]: Listening on Nix Daemon Socket.876gitlab # [ 6.931792] systemd[1]: Starting nixbot CI service socket...877gitlab # [ 6.933920] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.878gitlab # [ 6.936957] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 6.939207] systemd[1]: Reached target Socket Units.880gitlab # [ 6.941065] systemd[1]: Starting D-Bus System Message Bus...881gitlab # [ 6.968351] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'...882gitlab # [ 6.971836] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync'883gitlab # [ 6.974386] dbus-broker-launch[578]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"884gitlab # [ 6.979610] systemd[1]: Started D-Bus System Message Bus.885gitlab # [ 6.993317] dbus-broker-launch[578]: Ready886gitlab # [ 6.995831] systemd[1]: Reached target Basic System.887gitlab # [ 6.998546] systemd[1]: Started backdoor.service.888gitlab # [ 7.001662] systemd[1]: Starting gitlab-config.service...889gitlab # [ 7.004763] systemd[1]: Starting Import lastlog data into lastlog2 database...890gitlab # [ 7.023981] systemd[1]: Starting Logrotate configuration check...891gitlab # [ 7.028269] systemd[1]: Starting Name Service Cache Daemon (nsncd)...892gitlab # [ 7.031525] systemd[1]: Starting Post-Boot Actions...893gitlab # [ 7.034365] systemd[1]: Started Reset console on configuration changes.894gitlab # [ 7.041250] systemd[1]: Starting resolvconf update...895gitlab # [ 7.048070] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.896gitlab # connecting to host...897gitlab # [ 7.056352] logrotate[583]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf898gitlab # [ 7.057051] logrotate[583]: note: 'monthly' overrides previously specified 'weekly'899gitlab # [ 7.057350] logrotate[583]: Reading state from file: /var/lib/logrotate.status900gitlab # [ 7.057939] logrotate[583]: state file /var/lib/logrotate.status does not exist901gitlab # [ 7.058861] logrotate[583]: Allocating hash table for state file, size 64 entries902gitlab # [ 7.060975] logrotate[583]: Handling 4 logs903gitlab # [ 7.061372] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed904gitlab # [ 7.061978] logrotate[583]: considering log /var/log/btmp905gitlab # [ 7.062866] logrotate[583]: Creating new state906gitlab # [ 7.063767] logrotate[583]: Now: 2026-10-17 17:22907gitlab # [ 7.064690] logrotate[583]: Last rotated at 2026-10-17 17:00908gitlab # [ 7.065584] logrotate[583]: log does not need rotating (log has already been rotated)909gitlab # [ 7.066505] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed910gitlab # [ 7.067454] logrotate[583]: considering log /var/log/wtmp911gitlab # [ 7.068538] logrotate[583]: Creating new state912gitlab # [ 7.069662] logrotate[583]: Now: 2026-10-17 17:22913gitlab # [ 7.070997] logrotate[583]: Last rotated at 2026-10-17 17:00914gitlab # [ 7.071934] logrotate[583]: log does not need rotating (log has already been rotated)915gitlab # [ 7.073053] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed916gitlab # [ 7.073331] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583)917gitlab # [ 7.073687] logrotate[583]: considering log /var/gitlab/state/log/*.log918gitlab # [ 7.074211] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping919gitlab # [ 7.074642] logrotate[583]: Creating new state920gitlab: Guest shell says: b'Spawning backdoor root shell...\n'921gitlab # [ 7.075365] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583)922gitlab # [ 7.075863] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed923gitlab # [ 7.076483] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583)924gitlab # [ 7.076967] logrotate[583]: considering log /var/log/nginx/*.log925gitlab: connected to guest root shell926gitlab # [ 7.077720] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping927gitlab: (connecting took 7.75 seconds)928gitlab # [ 7.078194] logrotate[583]: Creating new state929gitlab: (finished: waiting for the VM to finish booting, in 7.75 seconds)930gitlab # [ 7.078678] logrotate[583]: not running postrotate script, since no logs were rotated931gitlab # [ 7.079190] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583)932gitlab # [ 7.079805] systemd[1]: Finished Logrotate configuration check.933gitlab # [ 7.096740] systemd[1]: Finished Post-Boot Actions.934gitlab # [ 7.100954] systemd[1]: Finished Import lastlog data into lastlog2 database.935gitlab # [ 7.107949] nsncd[584]: Oct 17 17:22:47.640 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"936gitlab # [ 7.109996] systemd[1]: Started Name Service Cache Daemon (nsncd).937gitlab # [ 7.110912] systemd[1]: Reached target Host and Network Name Lookups.938gitlab # [ 7.111932] systemd[1]: Reached target User and Group Name Lookups.939gitlab # [ 7.113317] systemd[1]: Starting User Login Management...940gitlab # [ 7.116298] systemd[1]: Stopped target Host and Network Name Lookups.941gitlab # [ 7.116431] systemd[1]: Stopping Host and Network Name Lookups...942gitlab # [ 7.116991] systemd[1]: Stopped target User and Group Name Lookups.943gitlab # [ 7.117782] systemd[1]: Stopping User and Group Name Lookups...944gitlab # [ 7.118672] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...945gitlab # [ 7.120501] systemd[1]: nscd.service: Deactivated successfully.946gitlab # [ 7.123714] systemd[1]: Stopped Name Service Cache Daemon (nsncd).947gitlab # [ 7.124341] systemd[1]: nscd.service: Consumed 14ms CPU time over 92ms wall clock time, 7.6M memory peak, 5.5M read from disk.948gitlab # [ 7.129481] systemd[1]: Starting Name Service Cache Daemon (nsncd)...949gitlab # [ 7.146781] systemd[1]: Finished resolvconf update.950gitlab # [ 7.148073] systemd[1]: Reached target Preparation for Network.951gitlab # [ 7.150637] systemd[1]: Starting DHCP Client...952gitlab # [ 7.152087] systemd[1]: Starting Address configuration of eth1...953gitlab # [ 7.155736] systemd[1]: Starting Extra networking commands....954gitlab # [ 7.156699] systemd[1]: Started Name Service Cache Daemon (nsncd).955gitlab # [ 7.158094] nsncd[670]: Oct 17 17:22:47.688 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"956gitlab # [ 7.161067] systemd[1]: Reached target Host and Network Name Lookups.957gitlab # [ 7.161521] systemd[1]: Reached target User and Group Name Lookups.958gitlab # [ 7.168238] systemd-logind[654]: New seat seat0.959gitlab # [ 7.173559] systemd-logind[654]: Watching system buttons on /dev/input/event2 (Power Button)960gitlab # [ 7.174129] systemd-logind[654]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)961gitlab # [ 7.174685] systemd-logind[654]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)962gitlab # [ 7.178080] systemd[1]: Started User Login Management.963gitlab # [ 7.179554] systemd[1]: Starting linger-users.service...964gitlab # [ 7.185475] network-addresses-eth1-start[688]: adding address 192.168.1.1/24... done965gitlab # [ 7.187440] network-addresses-eth1-start[688]: adding address 2001:db8:1::1/64... done966gitlab # [ 7.191064] systemd[1]: Finished Address configuration of eth1.967gitlab # [ 7.196121] systemd[1]: linger-users.service: Deactivated successfully.968gitlab # [ 7.196516] systemd[1]: Finished linger-users.service.969gitlab # [ 7.233162] dhcpcd[708]: dhcpcd-10.3.2 starting970gitlab # [ 7.234214] systemd[1]: Finished Extra networking commands..971gitlab # [ 7.234995] systemd[1]: Reached target Network.972gitlab # [ 7.235959] dhcpcd[766]: dev: loaded udev973gitlab # [ 7.236467] systemd[1]: Starting gitlab-workhorse.service...974gitlab # [ 7.240147] systemd[1]: Starting Nginx Web Server...975gitlab # [ 7.388157] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.388705] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.242884] systemd[1]: Starting PostgreSQL Server...978gitlab # [ 7.245760] systemd[1]: Starting Redis Server - redis-gitlab...979gitlab # [ 7.249075] systemd[1]: Starting Permit User Sessions...980gitlab # [ 7.255217] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.981gitlab # [ 7.265066] systemd[1]: Finished Permit User Sessions.982gitlab # [ 7.265881] systemd[1]: Started Getty on tty1.983gitlab # [ 7.266615] systemd[1]: Reached target Login Prompts.984gitlab # [ 7.479036] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 7.483629] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 7.485207] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 7.486825] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 7.488879] cfg80211: failed to load regulatory.db989gitlab # [ 7.353435] nginx-pre-start[794]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok990gitlab # [ 7.355354] nginx-pre-start[794]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful991gitlab # [ 7.358247] systemd[1]: Started Nginx Web Server.992gitlab # [ 7.367243] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres".993gitlab # [ 7.368961] postgresql-pre-start[793]: This user must also own the server process.994gitlab # [ 7.371772] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8".995gitlab # [ 7.373285] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8".996gitlab # [ 7.374695] postgresql-pre-start[793]: The default text search configuration will be set to "english".997gitlab # [ 7.376115] postgresql-pre-start[793]: Data page checksums are enabled.998gitlab # [ 7.377278] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok999gitlab # [ 7.378615] postgresql-pre-start[793]: creating subdirectories ... ok1000gitlab # [ 7.379631] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix1001gitlab # [ 7.381120] redis-server[791]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1002gitlab # [ 7.531442] 8021q: adding VLAN 0 to HW filter on device eth01003gitlab # [ 7.387099] systemd[1]: Started Redis Server - redis-gitlab.1004gitlab # [ 7.388201] redis-server[791]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1005gitlab # [ 7.389829] redis-server[791]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=791, just started1006gitlab # [ 7.391407] redis-server[791]: Configuration loaded1007gitlab # [ 7.392379] redis[791]: monotonic clock: POSIX clock_gettime1008gitlab # [ 7.393656] redis[791]: Running mode=standalone, port=0.1009gitlab # [ 7.394836] redis[791]: Server initialized1010gitlab # [ 7.395711] redis[791]: Ready to accept connections unix1011gitlab # [ 7.396863] redis[791]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1012gitlab # [ 7.398796] dhcpcd[766]: eth0: waiting for carrier1013gitlab # [ 7.399590] dhcpcd[766]: eth0: carrier acquired1014gitlab # [ 7.400382] dhcpcd[766]: DUID 00:01:00:01:32:66:6b:67:52:54:00:12:34:561015gitlab # [ 7.401282] dhcpcd[766]: eth0: IAID 00:12:34:561016gitlab # [ 7.401976] dhcpcd[766]: eth0: adding address fe80::5054:ff:fe12:34561017gitlab # [ 7.416809] postgresql-pre-start[793]: selecting default "max_connections" ... 1001018gitlab # [ 7.450223] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB1019gitlab # [ 7.642246] systemd[1]: Started gitlab-workhorse.service.1020gitlab # [ 7.789839] gitlab-workhorse[827]: time="2026-10-17T17:22:48Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41021gitlab # [ 7.790131] gitlab-workhorse[827]: time="2026-10-17T17:22:48Z" level=info msg="Using redis/go-redis"1022gitlab # [ 7.790825] gitlab-workhorse[827]: time="2026-10-17T17:22:48Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1023gitlab # [ 7.810151] postgresql-pre-start[793]: selecting default time zone ... UTC1024gitlab # [ 7.812356] postgresql-pre-start[793]: creating configuration files ... ok1025gitlab # [ 7.969484] postgresql-pre-start[793]: running bootstrap script ... ok1026gitlab # [ 8.375698] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok1027gitlab # [ 8.516968] dhcpcd[766]: eth0: soliciting a DHCP lease1028gitlab # [ 8.670691] NET: Registered PF_PACKET protocol family1029gitlab # [ 8.533839] dhcpcd[766]: eth0: offered 10.0.2.15 from 10.0.2.21030gitlab # [ 8.540370] dhcpcd[766]: eth0: probing address 10.0.2.15/241031gitlab # [ 8.620573] postgresql-pre-start[793]: syncing data to disk ... ok1032gitlab # [ 8.622524] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections1033gitlab # [ 8.625300] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1034gitlab # [ 8.630474] postgresql-pre-start[793]: Success. You can now start the database server using:1035gitlab # [ 8.633344] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1036gitlab # [ 8.733804] postgres[853]: [853] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1037gitlab # [ 8.738237] postgres[853]: [853] LOG: listening on IPv6 address "::1", port 54321038gitlab # [ 8.740962] postgres[853]: [853] LOG: listening on IPv4 address "127.0.0.1", port 54321039gitlab # [ 8.743867] postgres[853]: [853] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1040gitlab # [ 8.750959] postgres[863]: [863] LOG: database system was shut down at 2026-10-17 17:22:48 GMT1041gitlab # [ 8.757723] postgres[853]: [853] LOG: database system is ready to accept connections1042gitlab # [ 8.761913] systemd[1]: Started PostgreSQL Server.1043gitlab # [ 8.767197] systemd[1]: Starting PostgreSQL Setup Scripts...1044gitlab # [ 8.908502] postgresql-setup-start[874]: CREATE DATABASE1045gitlab # [ 8.935535] postgresql-setup-start[884]: CREATE ROLE1046gitlab # [ 8.943637] postgresql-setup-start[886]: ALTER DATABASE1047gitlab # [ 8.959470] postgresql-setup-start[891]: CREATE ROLE1048gitlab # [ 8.961471] systemd[1]: Finished PostgreSQL Setup Scripts.1049gitlab # [ 8.962556] systemd[1]: Reached target PostgreSQL.1050gitlab # [ 8.964870] systemd[1]: Starting gitlab-postgresql.service...1051gitlab # [ 8.991290] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[879]: mkdir -p /var/gitlab/state/home/.ssh: OK1052gitlab # [ 8.992627] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[879]: chmod 700 /var/gitlab/state/home/.ssh: OK1053gitlab # [ 9.030579] systemd[1]: Finished gitlab-config.service.1054gitlab # [ 9.034087] systemd[1]: Started gitaly.service.1055gitlab # [ 9.034223] systemd[1]: Starting gitlab-db-config.service...1056gitlab # [ 9.053148] gitlab-postgresql-start[903]: CREATE DATABASE1057gitlab # [ 9.076884] gitlab-postgresql-start[919]: CREATE EXTENSION1058gitlab # [ 9.145120] gitlab-postgresql-start[921]: CREATE EXTENSION1059gitlab # [ 9.149075] systemd[1]: Finished gitlab-postgresql.service.1060gitlab # [ 9.312766] dhcpcd[766]: eth0: soliciting an IPv6 router1061gitlab # [ 9.313727] dhcpcd[766]: eth0: Router Advertisement from fe80::21062gitlab # [ 9.314257] dhcpcd[766]: eth0: adding address fec0::5054:ff:fe12:3456/641063gitlab # [ 9.315100] dhcpcd[766]: eth0: adding route to fec0::/641064gitlab # [ 9.315748] dhcpcd[766]: eth0: adding default route via fe80::21065gitlab # [ 9.458910] gitaly[913]: time="2026-10-17T17:22:49.990Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9131066gitlab # [ 9.462215] gitaly[913]: time="2026-10-17T17:22:49.991Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9131067gitlab # [ 9.464105] gitaly[913]: time="2026-10-17T17:22:49.991Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9131068gitlab # [ 9.466051] gitaly[913]: time="2026-10-17T17:22:49.991Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9131069gitlab # [ 9.467736] gitaly[913]: time="2026-10-17T17:22:49.991Z" level=info msg="Starting Gitaly" pid=913 version=1070gitlab # [ 9.611231] gitaly[913]: time="2026-10-17T17:22:50.143Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=151 pid=9131071gitlab # [ 9.611768] gitaly[913]: time="2026-10-17T17:22:50.143Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9131072gitlab # [ 9.612703] gitaly[913]: time="2026-10-17T17:22:50.143Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9131073gitlab # [ 9.613537] gitaly[913]: time="2026-10-17T17:22:50.143Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-913/git-exec-1260576488.d/git pid=9131074gitlab # [ 9.618192] gitaly[913]: time="2026-10-17T17:22:50.150Z" level=info msg="finished detecting git version" duration_ms=6 pid=9131075gitlab # [ 9.618634] gitaly[913]: time="2026-10-17T17:22:50.150Z" level=info msg="using Git version" pid=913 version=2.53.g1076gitlab # [ 9.619734] gitaly[913]: time="2026-10-17T17:22:50.150Z" level=info msg="clearing disk cache object folder" pid=913 storage=default1077gitlab # [ 9.620315] gitaly[913]: time="2026-10-17T17:22:50.151Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2369985353 pid=913 storage=default1078gitlab # [ 9.620875] gitaly[913]: time="2026-10-17T17:22:50.151Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2369985353 pid=913 storage=default1079gitlab # [ 9.621666] gitaly[913]: time="2026-10-17T17:22:50.151Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9131080gitlab # [ 9.622534] gitaly[913]: time="2026-10-17T17:22:50.151Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9131081gitlab # [ 9.623149] gitaly[913]: time="2026-10-17T17:22:50.151Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2369985353 clear_duration_ms=0 pid=913 storage=default1082gitlab # [ 9.651299] gitaly[913]: time="2026-10-17T17:22:50.183Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9131083gitlab # [ 9.651593] gitaly[913]: time="2026-10-17T17:22:50.183Z" level=info msg="counting repositories" pid=9131084gitlab # [ 9.652060] gitaly[913]: time="2026-10-17T17:22:50.183Z" level=info msg="finished tempdir cleaner walk" pid=913 storage=default time_ms=01085gitlab # [ 9.652611] gitaly[913]: time="2026-10-17T17:22:50.183Z" level=info msg="starting to count repositories" pid=913 storage_path=/var/gitlab/state/repositories1086gitlab # [ 9.653169] gitaly[913]: time="2026-10-17T17:22:50.183Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=913 schema=unix1087gitlab # [ 9.653659] gitaly[913]: time="2026-10-17T17:22:50.183Z" level=info msg="listening at address" address=/run/gitaly/gitaly-913/sock.d/intern pid=913 schema=unix1088gitlab # [ 9.662384] gitaly[913]: time="2026-10-17T17:22:50.194Z" level=info msg="completed counting repositories" counting_duration_ms=10 pid=913 storage_path=/var/gitlab/state/repositories1089gitlab # [ 9.662551] gitaly[913]: time="2026-10-17T17:22:50.194Z" level=info msg="completed counting all repositories" counting_duration=11 pid=9131090gitlab # [ 9.663213] gitaly[913]: time="2026-10-17T17:22:50.194Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9131091gitlab # [ 9.663405] gitaly[913]: time="2026-10-17T17:22:50.194Z" level=info msg="Started Gitaly" duration_ms=203 pid=9131092gitlab # [ 9.663978] gitaly[913]: time="2026-10-17T17:22:50.194Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9131093gitlab # [ 9.664792] gitaly[913]: time="2026-10-17T17:22:50.195Z" level=info msg="maintenance: daily scheduled" pid=913 scheduled="2026-10-18 12:00:00 +0000 UTC"1094gitlab # [ 10.104733] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1095gitlab # [ 10.105904] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1096gitlab # [ 10.121111] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1097gitlab # [ 11.535219] gitaly[913]: time="2026-10-17T17:22:52.066Z" level=info msg="License database preloaded" duration_ms=2075 pid=9131098gitlab # [ 13.102249] dhcpcd[766]: eth0: leased 10.0.2.15 for 86400 seconds1099gitlab # [ 13.102619] dhcpcd[766]: eth0: adding route to 10.0.2.0/241100gitlab # [ 13.104423] dhcpcd[766]: eth0: adding default route via 10.0.2.21101gitlab # [ 13.200446] systemd[1]: Started DHCP Client.1102gitlab # [ 13.203314] systemd[1]: Reached target Network is Online.1103gitlab # [ 39.206636] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: W, [2026-10-17T17:23:19.738205 #916] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1104gitlab # [ 41.267965] postgres[1301]: [1301] ERROR: relation "feature_gates" does not exist at character 5231105gitlab # [ 41.269282] postgres[1301]: [1301] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1106gitlab # [ 41.270439] postgres[1301]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1107gitlab # [ 41.271655] postgres[1301]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1108gitlab # [ 41.272798] postgres[1301]: attidentity AS identity,1109gitlab # [ 41.273580] postgres[1301]: attgenerated as attgenerated1110gitlab # [ 41.274708] postgres[1301]: FROM pg_attribute a1111gitlab # [ 41.275627] postgres[1301]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1112gitlab # [ 41.277228] postgres[1301]: LEFT JOIN pg_type t ON a.atttypid = t.oid1113gitlab # [ 41.278387] postgres[1301]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1114gitlab # [ 41.280187] postgres[1301]: WHERE a.attrelid = '"feature_gates"'::regclass1115gitlab # [ 41.281432] postgres[1301]: AND a.attnum > 0 AND NOT a.attisdropped1116gitlab # [ 41.282627] postgres[1301]: ORDER BY a.attnum1117gitlab # [ 41.283540] postgres[1301]:1118gitlab # [ 44.566248] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1338]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 44.571899] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1338]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 47.831523] gitlab-workhorse[827]: time="2026-10-17T17:23:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 57.840909] gitlab-workhorse[827]: time="2026-10-17T17:23:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 58.732819] postgres[1409]: [1409] ERROR: relation "table_without_models" does not exist1123gitlab # [ 58.734192] postgres[1409]: [1409] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1124gitlab # [ 67.846548] gitlab-workhorse[827]: time="2026-10-17T17:23:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 69.051230] systemd[1]: Finished gitlab-db-config.service.1126gitlab # [ 69.055141] systemd[1]: Started gitlab-sidekiq.service.1127gitlab # [ 69.056154] systemd[1]: Starting gitlab.service...1128gitlab # [ 69.418446] bundle[1558]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1129gitlab # [ 69.418726] bundle[1558]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1130gitlab # [ 69.419939] bundle[1558]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1131gitlab # [ 72.053442] sidekiq-cluster[1557]: {"severity":"INFO","time":"2026-10-17T17:23:52.568Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 72.139062] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.650Z","pid":1558,"message":"* Enabling systemd notification integration"}1133gitlab # [ 72.143072] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.670Z","pid":1558,"message":"Puma starting in cluster mode..."}1134gitlab # [ 72.146614] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.670Z","pid":1558,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1135gitlab # [ 72.150311] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.670Z","pid":1558,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 72.154684] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.670Z","pid":1558,"message":"* Min threads: 0"}1137gitlab # [ 72.157770] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.670Z","pid":1558,"message":"* Max threads: 4"}1138gitlab # [ 72.160800] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.670Z","pid":1558,"message":"* Environment: production"}1139gitlab # [ 72.164081] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.670Z","pid":1558,"message":"* Master PID: 1558"}1140gitlab # [ 72.167239] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.671Z","pid":1558,"message":"* Workers: 2"}1141gitlab # [ 72.170299] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.671Z","pid":1558,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 72.174148] bundle[1558]: {"timestamp":"2026-10-17T17:23:52.671Z","pid":1558,"message":"* Preloading application"}1143gitlab # [ 77.847844] gitlab-workhorse[827]: time="2026-10-17T17:23:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 87.853514] gitlab-workhorse[827]: time="2026-10-17T17:24:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 94.398378] bundle[1558]: W, [2026-10-17T17:24:14.929310 #1558] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 96.341583] sidekiq-cluster[1588]: 2026-10-17T17:24:16.873Z pid=1588 tid=wik INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1588, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>429301760}1147gitlab # [ 96.508730] sidekiq-cluster[1588]: W, [2026-10-17T17:24:17.040949 #1588] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1148gitlab # [ 96.546853] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:17.079Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1149gitlab # [ 97.856401] gitlab-workhorse[827]: time="2026-10-17T17:24:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1150gitlab # [ 98.434520] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:18.965Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 98.435357] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:18.966Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 98.467124] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:18.999Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 98.474309] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.006Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 98.485474] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.017Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 98.491807] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.023Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 98.496306] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.028Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 98.508604] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.040Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 98.517350] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.049Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 98.521397] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.053Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 98.526092] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.058Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 98.538108] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.069Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 98.546534] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.078Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 98.556135] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.088Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 98.562778] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.095Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 98.568472] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.100Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 98.572616] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.104Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 98.574813] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.106Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 98.576462] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.108Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 98.578615] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.110Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 98.580851] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.113Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 98.583033] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.115Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 98.585430] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.117Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 98.587295] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.119Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 98.589489] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.121Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 98.591539] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.123Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 98.593226] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.125Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 98.595856] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.128Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 98.598107] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.130Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 98.600291] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.132Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 98.602394] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.134Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 98.604728] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.137Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 98.607252] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.139Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 98.609758] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.142Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 98.611985] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.144Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 98.614419] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.146Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 98.616451] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.148Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 98.618098] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.150Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 98.620641] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.152Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 98.622788] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.155Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 98.624621] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.156Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 98.626637] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.158Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 98.628700] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.161Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 98.630340] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.162Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 98.632741] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.165Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 98.634644] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.166Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 98.637105] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.169Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 98.638915] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.171Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 98.640975] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.173Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 98.643293] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.175Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 98.645416] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.177Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 98.647223] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.179Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 98.649575] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.181Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 98.651914] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.184Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 98.660224] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.192Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 98.662700] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.195Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 98.664629] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.196Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 98.666895] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.199Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 98.669036] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.201Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 98.671634] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.203Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 98.673233] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.205Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 98.675756] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.208Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 98.677888] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.210Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 98.679498] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.211Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 98.682119] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.214Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 98.684526] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.216Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 98.686769] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.218Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 98.689288] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.221Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 98.690993] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.223Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 98.693056] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.225Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 98.694990] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.227Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 98.696794] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.229Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 98.698624] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.230Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 98.729300] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.261Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 98.730815] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.263Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 98.732907] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.265Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 98.734965] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.267Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 98.737591] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.269Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 98.739159] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.271Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 98.741492] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.273Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 98.743222] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.275Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 98.744986] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.277Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 98.747350] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.279Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 98.749177] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.281Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 98.752045] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.284Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 98.753618] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.285Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 98.759332] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.291Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 98.763160] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.295Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 98.767822] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.300Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 98.771256] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.303Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 98.775196] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.307Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 98.778727] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.311Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 98.782641] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.314Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 98.786113] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.318Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 98.790067] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.322Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 98.792361] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.324Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 98.794481] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.326Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 98.796977] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.329Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 98.799110] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.331Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 98.800662] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.332Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 98.809578] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.341Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 98.811441] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.343Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 98.813184] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.345Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 98.816506] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.348Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 98.818614] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.350Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 98.820810] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.353Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 98.823112] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.355Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 98.824625] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.356Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 98.826325] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.358Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 98.829171] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.361Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 98.830717] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:19.363Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 107.865196] gitlab-workhorse[827]: time="2026-10-17T17:24:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 117.866934] gitlab-workhorse[827]: time="2026-10-17T17:24:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 124.439462] postgres[2044]: [2044] ERROR: relation "table_without_models" does not exist1264gitlab # [ 124.440222] postgres[2044]: [2044] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 125.306809] postgres[2050]: [2050] ERROR: relation "table_without_models" does not exist1266gitlab # [ 125.307198] postgres[2050]: [2050] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1267gitlab # [ 127.007346] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:47.539Z","message":"Booted Rails 7.2.3.1 application in production environment"}1268gitlab # [ 127.009328] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:47.541Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1269gitlab # [ 127.010188] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:47.542Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1270gitlab # [ 127.011327] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:47.543Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1271gitlab # [ 127.015244] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:47.547Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1272gitlab # [ 127.868332] gitlab-workhorse[827]: time="2026-10-17T17:24:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1273gitlab # [ 128.134562] bundle[1558]: {"timestamp":"2026-10-17T17:24:48.665Z","pid":1558,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1274gitlab # [ 128.135250] bundle[1558]: {"timestamp":"2026-10-17T17:24:48.666Z","pid":1558,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1275gitlab # [ 128.136128] bundle[1558]: {"timestamp":"2026-10-17T17:24:48.666Z","pid":1558,"message":"! #\u003cThread:0x00007de0b4b8d7c0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1276gitlab # [ 128.136831] bundle[1558]: {"timestamp":"2026-10-17T17:24:48.666Z","pid":1558,"message":"! #\u003cThread:0x00007de0b4d610b0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1277gitlab # [ 128.137714] bundle[1558]: {"timestamp":"2026-10-17T17:24:48.666Z","pid":1558,"message":"Use Ctrl-C to stop"}1278gitlab # [ 128.138622] bundle[1558]: {"timestamp":"2026-10-17T17:24:48.666Z","pid":1558,"message":"Sending status to systemd every 1.0 sec"}1279gitlab # [ 128.294234] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:48.825Z","message":"Cleaning working queues"}1280gitlab # [ 128.297242] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:48.829Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"337b879100c62c637f0d3bef","created_at":"2026-10-17T17:23:49.196Z","trace_propagation_headers":{"sentry-trace":"79e24a23e2524df187ddcff1c1f487eb-72d97a769504426e","baggage":"sentry-trace_id=79e24a23e2524df187ddcff1c1f487eb,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ce54b7e5390410bec73e558f11a8efa7","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-17T17:23:49.202Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-337b879100c62c637f0d3bef: start","job_status":"start","queue_duration_s":59.626518,"scheduling_latency_s":59.62658}1281gitlab # [ 128.415109] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:24:48.947Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"337b879100c62c637f0d3bef","created_at":"2026-10-17T17:23:49.196Z","trace_propagation_headers":{"sentry-trace":"79e24a23e2524df187ddcff1c1f487eb-72d97a769504426e","baggage":"sentry-trace_id=79e24a23e2524df187ddcff1c1f487eb,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ce54b7e5390410bec73e558f11a8efa7","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-17T17:23:49.202Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-337b879100c62c637f0d3bef: done: 0.118262 sec","job_status":"done","queue_duration_s":59.626518,"scheduling_latency_s":59.62658,"redis_calls":26,"redis_duration_s":0.003627,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.001932,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.059790839000000005,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.118262,"completed_at":"2026-10-17T17:24:48.947Z","load_balancing_strategy":"primary","db_duration_s":0.028188,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1282gitlab # [ 128.817323] bundle[1558]: {"timestamp":"2026-10-17T17:24:49.349Z","pid":1558,"message":"- Worker 0 (PID: 2138) booted in 0.62s, phase: 0"}1283gitlab # [ 128.909668] bundle[1558]: {"timestamp":"2026-10-17T17:24:49.441Z","pid":1558,"message":"- Worker 1 (PID: 2142) booted in 0.7s, phase: 0"}1284gitlab # [ 128.913448] systemd[1]: Started gitlab.service.1285gitlab # [ 128.914512] systemd[1]: Reached target Common target for all GitLab services..1286gitlab # [ 128.917482] systemd[1]: Starting setup-gitlab.service...1287gitlab # [ 128.943237] setup-gitlab-start[2183]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1288gitlab # [ 130.875478] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:24:51 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 19131289gitlab # [ 130.879059] setup-gitlab-start[2183]: + TOKEN=nixbot-test-token-of-20-chars1290gitlab # [ 130.879494] setup-gitlab-start[2183]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1291gitlab # [ 130.892798] runuser[2201]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1292gitlab # [ 131.251402] setup-gitlab-start[2202]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 131.252096] setup-gitlab-start[2202]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 131.256130] setup-gitlab-start[2202]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 131.825375] setup-gitlab-start[2202]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1296gitlab # [ 131.827504] setup-gitlab-start[2202]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1297gitlab # [ 131.831275] setup-gitlab-start[2202]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1298gitlab # [ 140.521217] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f76d74e6c8d787dfdbdff5ff","created_at":"2026-10-17T17:25:01.032Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b14d91f5d7e810cdb03a08c66f94b67","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.050Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f76d74e6c8d787dfdbdff5ff: start","job_status":"start","queue_duration_s":0.002249,"scheduling_latency_s":0.002295}1299gitlab # [ 140.606390] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f76d74e6c8d787dfdbdff5ff","created_at":"2026-10-17T17:25:01.032Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b14d91f5d7e810cdb03a08c66f94b67","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.050Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f76d74e6c8d787dfdbdff5ff: done: 0.086169 sec","job_status":"done","queue_duration_s":0.002249,"scheduling_latency_s":0.002295,"redis_calls":12,"redis_duration_s":0.007105,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00195,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00347,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001555505,"exclusive_lock_hold_duration_s":0.006844724,"duration_s":0.086169,"completed_at":"2026-10-17T17:25:01.138Z","load_balancing_strategy":"primary","db_duration_s":0.019941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 140.644983] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"20557cfad1995a44344a71e9","created_at":"2026-10-17T17:25:01.089Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3da17f2dbc09e11a52260252625ca12e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.100Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-20557cfad1995a44344a71e9: start","job_status":"start","queue_duration_s":0.076768,"scheduling_latency_s":0.076804}1301gitlab # [ 140.681232] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"20557cfad1995a44344a71e9","created_at":"2026-10-17T17:25:01.089Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3da17f2dbc09e11a52260252625ca12e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.100Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-20557cfad1995a44344a71e9: done: 0.036422 sec","job_status":"done","queue_duration_s":0.076768,"scheduling_latency_s":0.076804,"redis_calls":10,"redis_duration_s":0.00711,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002234362,"duration_s":0.036422,"completed_at":"2026-10-17T17:25:01.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 140.684058] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"680c3730714b23121680a5ac","created_at":"2026-10-17T17:25:01.123Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c0ccd81381028a635ae93f22669a626","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.195Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-680c3730714b23121680a5ac: start","job_status":"start","queue_duration_s":0.020982,"scheduling_latency_s":0.021}1303gitlab # [ 141.111250] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"680c3730714b23121680a5ac","created_at":"2026-10-17T17:25:01.123Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c0ccd81381028a635ae93f22669a626","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.195Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-680c3730714b23121680a5ac: done: 0.427006 sec","job_status":"done","queue_duration_s":0.020982,"scheduling_latency_s":0.021,"redis_calls":565,"redis_duration_s":0.21394,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000752,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.211898,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.199455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000291657,"duration_s":0.427006,"completed_at":"2026-10-17T17:25:01.643Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 141.187283] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6947f7aa575c9370bba21266","created_at":"2026-10-17T17:25:01.206Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3878733e44689300cf8f4f183cf53e3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.266Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6947f7aa575c9370bba21266: start","job_status":"start","queue_duration_s":0.377815,"scheduling_latency_s":0.37783}1305gitlab # [ 141.200029] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.653Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1306gitlab # [ 141.203078] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.658Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6947f7aa575c9370bba21266","created_at":"2026-10-17T17:25:01.206Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3878733e44689300cf8f4f183cf53e3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.266Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6947f7aa575c9370bba21266: done: 0.014265 sec","job_status":"done","queue_duration_s":0.377815,"scheduling_latency_s":0.37783,"redis_calls":10,"redis_duration_s":0.00207,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000296965,"duration_s":0.014265,"completed_at":"2026-10-17T17:25:01.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 141.240659] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.659Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"91b91f5fb537e771f5921946","created_at":"2026-10-17T17:25:01.270Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c02784a0450220fca10e8c5f749ac9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.275Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-91b91f5fb537e771f5921946: start","job_status":"start","queue_duration_s":0.384301,"scheduling_latency_s":0.384313}1308gitlab # [ 141.254196] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"91b91f5fb537e771f5921946","created_at":"2026-10-17T17:25:01.270Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c02784a0450220fca10e8c5f749ac9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.275Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-91b91f5fb537e771f5921946: done: 0.014979 sec","job_status":"done","queue_duration_s":0.384301,"scheduling_latency_s":0.384313,"redis_calls":12,"redis_duration_s":0.002578,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000934,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025953,"duration_s":0.014979,"completed_at":"2026-10-17T17:25:01.674Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 141.274739] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0892ea2a7fdc766cc24be43c","created_at":"2026-10-17T17:25:01.289Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc74c0a068653eb597cdefddf746fed4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-17T17:25:01.294Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0892ea2a7fdc766cc24be43c: start","job_status":"start","queue_duration_s":0.381872,"scheduling_latency_s":0.381885}1310gitlab # [ 141.275539] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.692Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1311gitlab # [ 141.275975] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.703Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0892ea2a7fdc766cc24be43c","created_at":"2026-10-17T17:25:01.289Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc74c0a068653eb597cdefddf746fed4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-17T17:25:01.294Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0892ea2a7fdc766cc24be43c: done: 0.027679 sec","job_status":"done","queue_duration_s":0.381872,"scheduling_latency_s":0.381885,"redis_calls":10,"redis_duration_s":0.00212,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00124,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000451733,"duration_s":0.027679,"completed_at":"2026-10-17T17:25:01.703Z","load_balancing_strategy":"primary","db_duration_s":0.000522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 141.320510] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.705Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"52517396b9821156711225c4","created_at":"2026-10-17T17:25:01.297Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e897b49aa6559df8f533828d98d9152","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.302Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-52517396b9821156711225c4: start","job_status":"start","queue_duration_s":0.403199,"scheduling_latency_s":0.403224}1313gitlab # [ 141.321229] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.730Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"52517396b9821156711225c4","created_at":"2026-10-17T17:25:01.297Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e897b49aa6559df8f533828d98d9152","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.302Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-52517396b9821156711225c4: done: 0.025304 sec","job_status":"done","queue_duration_s":0.403199,"scheduling_latency_s":0.403224,"redis_calls":17,"redis_duration_s":0.0027170000000000002,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001309,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000194,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00018941,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.025304,"completed_at":"2026-10-17T17:25:01.730Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 141.367709] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.731Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"89bff4c47f10a439ae29e7e8","created_at":"2026-10-17T17:25:01.307Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"332734bc52228dac64a20d7683665664","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.311Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-89bff4c47f10a439ae29e7e8: start","job_status":"start","queue_duration_s":0.420016,"scheduling_latency_s":0.420029}1315gitlab # [ 141.368469] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"89bff4c47f10a439ae29e7e8","created_at":"2026-10-17T17:25:01.307Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"332734bc52228dac64a20d7683665664","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.311Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-89bff4c47f10a439ae29e7e8: done: 0.045565 sec","job_status":"done","queue_duration_s":0.420016,"scheduling_latency_s":0.420029,"redis_calls":12,"redis_duration_s":0.00181,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000752,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000367365,"exclusive_lock_hold_duration_s":0.022343063,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.045565,"completed_at":"2026-10-17T17:25:01.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 141.420324] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:01.778Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d51e3f3e1cec8757d12ef979","created_at":"2026-10-17T17:25:01.316Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a44811806013bf9650b3a3b3829010f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.323Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d51e3f3e1cec8757d12ef979: start","job_status":"start","queue_duration_s":0.45474,"scheduling_latency_s":0.454754}1317gitlab # [ 141.625737] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.157Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d51e3f3e1cec8757d12ef979","created_at":"2026-10-17T17:25:01.316Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a44811806013bf9650b3a3b3829010f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.323Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d51e3f3e1cec8757d12ef979: done: 0.378759 sec","job_status":"done","queue_duration_s":0.45474,"scheduling_latency_s":0.454754,"redis_calls":14,"redis_duration_s":0.001961,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000496,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.224,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.223,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.144249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000315124,"exclusive_lock_hold_duration_s":0.363056198,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.378759,"completed_at":"2026-10-17T17:25:02.157Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.24023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 141.696788] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.228Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6ccda25a4529cce0501fa810","created_at":"2026-10-17T17:25:01.337Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e4b9b00a4e10e3e814bca3d86edbfc6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.342Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6ccda25a4529cce0501fa810: start","job_status":"start","queue_duration_s":0.886329,"scheduling_latency_s":0.886371}1319gitlab # [ 141.734576] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.266Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6ccda25a4529cce0501fa810","created_at":"2026-10-17T17:25:01.337Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e4b9b00a4e10e3e814bca3d86edbfc6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.342Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6ccda25a4529cce0501fa810: done: 0.037832 sec","job_status":"done","queue_duration_s":0.886329,"scheduling_latency_s":0.886371,"redis_calls":10,"redis_duration_s":0.0031260000000000003,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000639,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001873,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000537498,"duration_s":0.037832,"completed_at":"2026-10-17T17:25:02.266Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 141.772963] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"090cf271fba7071a2a860e2d","created_at":"2026-10-17T17:25:01.348Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c40806ad2bf394c202f626e9021d379a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.353Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-090cf271fba7071a2a860e2d: start","job_status":"start","queue_duration_s":0.951671,"scheduling_latency_s":0.951698}1321gitlab # [ 141.791363] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.323Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1322gitlab # [ 141.803952] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"090cf271fba7071a2a860e2d","created_at":"2026-10-17T17:25:01.348Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c40806ad2bf394c202f626e9021d379a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.353Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-090cf271fba7071a2a860e2d: done: 0.030457 sec","job_status":"done","queue_duration_s":0.951671,"scheduling_latency_s":0.951698,"redis_calls":10,"redis_duration_s":0.0034000000000000002,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000653,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000612,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000820216,"duration_s":0.030457,"completed_at":"2026-10-17T17:25:02.335Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000735,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 141.843213] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d51144b042e4e3332998157c","created_at":"2026-10-17T17:25:01.359Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0cda9334046231e3536cd2fb10a253b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.363Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d51144b042e4e3332998157c: start","job_status":"start","queue_duration_s":1.010995,"scheduling_latency_s":1.011046}1324gitlab # [ 141.887218] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.418Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d51144b042e4e3332998157c","created_at":"2026-10-17T17:25:01.359Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0cda9334046231e3536cd2fb10a253b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.363Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d51144b042e4e3332998157c: done: 0.043456 sec","job_status":"done","queue_duration_s":1.010995,"scheduling_latency_s":1.011046,"redis_calls":12,"redis_duration_s":0.002496,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000869,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000689753,"exclusive_lock_hold_duration_s":0.004494705000000001,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.043456,"completed_at":"2026-10-17T17:25:02.418Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 141.926824] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d7a733063ed009a6d8696e9b","created_at":"2026-10-17T17:25:01.374Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbd2f8c715d2d57eaea65ac6d1504ecc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-17T17:25:01.378Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d7a733063ed009a6d8696e9b: start","job_status":"start","queue_duration_s":1.079772,"scheduling_latency_s":1.079809}1326gitlab # [ 141.947719] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.479Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1327gitlab # [ 141.962137] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d7a733063ed009a6d8696e9b","created_at":"2026-10-17T17:25:01.374Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbd2f8c715d2d57eaea65ac6d1504ecc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-17T17:25:01.378Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d7a733063ed009a6d8696e9b: done: 0.034832 sec","job_status":"done","queue_duration_s":1.079772,"scheduling_latency_s":1.079809,"redis_calls":10,"redis_duration_s":0.001563,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000221257,"duration_s":0.034832,"completed_at":"2026-10-17T17:25:02.493Z","load_balancing_strategy":"primary","db_duration_s":0.000592,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 141.983216] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.496Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"768ec43d7db91d56a7a5a4f1","created_at":"2026-10-17T17:25:01.393Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e7bd115d663578326ff67e625378392","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-17T17:25:01.398Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-768ec43d7db91d56a7a5a4f1: start","job_status":"start","queue_duration_s":1.097734,"scheduling_latency_s":1.097766}1329gitlab # [ 142.001779] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"768ec43d7db91d56a7a5a4f1","created_at":"2026-10-17T17:25:01.393Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e7bd115d663578326ff67e625378392","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-17T17:25:01.398Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-768ec43d7db91d56a7a5a4f1: done: 0.037101 sec","job_status":"done","queue_duration_s":1.097734,"scheduling_latency_s":1.097766,"redis_calls":10,"redis_duration_s":0.0027689999999999998,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000499,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000586,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000452012,"duration_s":0.037101,"completed_at":"2026-10-17T17:25:02.533Z","load_balancing_strategy":"primary","db_duration_s":0.004528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 142.048659] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b331a749e3c47790a3898736","created_at":"2026-10-17T17:25:01.403Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0224d05cb3b347c57d9d77c2888f0c39","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.409Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b331a749e3c47790a3898736: start","job_status":"start","queue_duration_s":1.170841,"scheduling_latency_s":1.170866}1331gitlab # [ 142.083056] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b331a749e3c47790a3898736","created_at":"2026-10-17T17:25:01.403Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0224d05cb3b347c57d9d77c2888f0c39","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.409Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b331a749e3c47790a3898736: done: 0.034383 sec","job_status":"done","queue_duration_s":1.170841,"scheduling_latency_s":1.170866,"redis_calls":13,"redis_duration_s":0.001779,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0068505910000000005,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.034383,"completed_at":"2026-10-17T17:25:02.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003039,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1332gitlab # [ 142.124050] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.655Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"67fe844019b48c7a1bb46ddd","created_at":"2026-10-17T17:25:01.416Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccc97723d609ef6a1bc2f65d8bf8ccdd","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.420Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-67fe844019b48c7a1bb46ddd: start","job_status":"start","queue_duration_s":1.235324,"scheduling_latency_s":1.235348}1333gitlab # [ 142.180168] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"67fe844019b48c7a1bb46ddd","created_at":"2026-10-17T17:25:01.416Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccc97723d609ef6a1bc2f65d8bf8ccdd","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.420Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-67fe844019b48c7a1bb46ddd: done: 0.055838 sec","job_status":"done","queue_duration_s":1.235324,"scheduling_latency_s":1.235348,"redis_calls":10,"redis_duration_s":0.002178,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000447,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039167,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.055838,"completed_at":"2026-10-17T17:25:02.711Z","load_balancing_strategy":"primary","db_duration_s":0.013156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 142.219587] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"40d958f4c86cd5b17849b12f","created_at":"2026-10-17T17:25:01.433Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.437Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-40d958f4c86cd5b17849b12f: start","job_status":"start","queue_duration_s":1.313656,"scheduling_latency_s":1.313685}1335gitlab # [ 142.281215] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"40d958f4c86cd5b17849b12f","created_at":"2026-10-17T17:25:01.433Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.437Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-40d958f4c86cd5b17849b12f: done: 0.061597 sec","job_status":"done","queue_duration_s":1.313656,"scheduling_latency_s":1.313685,"redis_calls":19,"redis_duration_s":0.005934,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001709,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000345,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002942,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039586,"duration_s":0.061597,"completed_at":"2026-10-17T17:25:02.813Z","load_balancing_strategy":"primary","db_duration_s":0.002705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 142.332297] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c2bf7208abcde2f937155210","created_at":"2026-10-17T17:25:01.444Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f07cfaa29d65a977e8082d01b7aa3fcb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.450Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c2bf7208abcde2f937155210: start","job_status":"start","queue_duration_s":1.413732,"scheduling_latency_s":1.413761}1337gitlab # [ 142.358100] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.890Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1338gitlab # [ 142.370102] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c2bf7208abcde2f937155210","created_at":"2026-10-17T17:25:01.444Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f07cfaa29d65a977e8082d01b7aa3fcb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.450Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c2bf7208abcde2f937155210: done: 0.037665 sec","job_status":"done","queue_duration_s":1.413732,"scheduling_latency_s":1.413761,"redis_calls":10,"redis_duration_s":0.003085,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000581,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001602,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000495035,"duration_s":0.037665,"completed_at":"2026-10-17T17:25:02.901Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 142.372587] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:02.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ed248c99edec06e5472dc5a5","created_at":"2026-10-17T17:25:01.456Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.469Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ed248c99edec06e5472dc5a5: start","job_status":"start","queue_duration_s":1.434932,"scheduling_latency_s":1.434965}1340gitlab # [ 142.471199] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ed248c99edec06e5472dc5a5","created_at":"2026-10-17T17:25:01.456Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.469Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ed248c99edec06e5472dc5a5: done: 0.098628 sec","job_status":"done","queue_duration_s":1.434932,"scheduling_latency_s":1.434965,"redis_calls":71,"redis_duration_s":0.016955,"redis_read_bytes":120,"redis_write_bytes":42574,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002795,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001045,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012342,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000773,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000278527,"duration_s":0.098628,"completed_at":"2026-10-17T17:25:03.003Z","load_balancing_strategy":"primary","db_duration_s":0.002611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 142.519849] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.051Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"14deb8a409023158e4e63689","created_at":"2026-10-17T17:25:01.474Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5bd9710bde0138d3450ed807161d624c","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.478Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-14deb8a409023158e4e63689: start","job_status":"start","queue_duration_s":1.572758,"scheduling_latency_s":1.57279}1342gitlab # [ 142.553373] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"14deb8a409023158e4e63689","created_at":"2026-10-17T17:25:01.474Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5bd9710bde0138d3450ed807161d624c","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.478Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-14deb8a409023158e4e63689: done: 0.034 sec","job_status":"done","queue_duration_s":1.572758,"scheduling_latency_s":1.57279,"redis_calls":10,"redis_duration_s":0.002707,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000538,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000427988,"duration_s":0.034,"completed_at":"2026-10-17T17:25:03.085Z","load_balancing_strategy":"primary","db_duration_s":0.005251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 142.591286] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ff34fe829a5db6e634353689","created_at":"2026-10-17T17:25:01.483Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbf0af544f38f52b35e43de842640aca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.487Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ff34fe829a5db6e634353689: start","job_status":"start","queue_duration_s":1.635397,"scheduling_latency_s":1.635431}1344gitlab # [ 142.647128] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ff34fe829a5db6e634353689","created_at":"2026-10-17T17:25:01.483Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbf0af544f38f52b35e43de842640aca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.487Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ff34fe829a5db6e634353689: done: 0.054938 sec","job_status":"done","queue_duration_s":1.635397,"scheduling_latency_s":1.635431,"redis_calls":12,"redis_duration_s":0.003757,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000601,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000724393,"exclusive_lock_hold_duration_s":0.024545298,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.054938,"completed_at":"2026-10-17T17:25:03.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013206,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 142.695748] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"51e6a870cb36366a166a3b0d","created_at":"2026-10-17T17:25:01.494Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09320b5a04c2edcb6cd644c192821c10","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.499Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-51e6a870cb36366a166a3b0d: start","job_status":"start","queue_duration_s":1.728118,"scheduling_latency_s":1.728159}1346gitlab # [ 142.724927] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.256Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1347gitlab # [ 142.736636] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"51e6a870cb36366a166a3b0d","created_at":"2026-10-17T17:25:01.494Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09320b5a04c2edcb6cd644c192821c10","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.499Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-51e6a870cb36366a166a3b0d: done: 0.04054 sec","job_status":"done","queue_duration_s":1.728118,"scheduling_latency_s":1.728159,"redis_calls":10,"redis_duration_s":0.002905,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000615,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000461511,"duration_s":0.04054,"completed_at":"2026-10-17T17:25:03.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 142.775934] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.307Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a1112028fb97698f6a153a27","created_at":"2026-10-17T17:25:01.504Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79e50e89fc9b15d534ced05ead2a9786","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.509Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a1112028fb97698f6a153a27: start","job_status":"start","queue_duration_s":1.798489,"scheduling_latency_s":1.798527}1349gitlab # [ 142.806316] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a1112028fb97698f6a153a27","created_at":"2026-10-17T17:25:01.504Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-ded095a2d8f14124","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79e50e89fc9b15d534ced05ead2a9786","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:01.509Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a1112028fb97698f6a153a27: done: 0.029953 sec","job_status":"done","queue_duration_s":1.798489,"scheduling_latency_s":1.798527,"redis_calls":10,"redis_duration_s":0.002911,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000575,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000454806,"duration_s":0.029953,"completed_at":"2026-10-17T17:25:03.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 142.808496] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.340Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"033834cfed401c5effdef64a","created_at":"2026-10-17T17:25:02.787Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-71e76ed6090d42c4","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.803Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-033834cfed401c5effdef64a: start","job_status":"start","queue_duration_s":0.536494,"scheduling_latency_s":0.536523}1351gitlab # [ 142.875400] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.407Z","message":"No existing merge request to be cleaned up."}1352gitlab # [ 142.895585] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.427Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"033834cfed401c5effdef64a","created_at":"2026-10-17T17:25:02.787Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-71e76ed6090d42c4","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.803Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-033834cfed401c5effdef64a: done: 0.086968 sec","job_status":"done","queue_duration_s":0.536494,"scheduling_latency_s":0.536523,"redis_calls":13,"redis_duration_s":0.004458999999999999,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000392,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000394743,"duration_s":0.086968,"completed_at":"2026-10-17T17:25:03.427Z","load_balancing_strategy":"primary","db_duration_s":0.004799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 142.932378] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.464Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e75c732aeefd238294740983","created_at":"2026-10-17T17:25:02.787Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-71e76ed6090d42c4","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.803Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e75c732aeefd238294740983: start","job_status":"start","queue_duration_s":0.660314,"scheduling_latency_s":0.66035}1354gitlab # [ 142.956379] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.488Z","message":"No existing merge request to be cleaned up."}1355gitlab # [ 142.969778] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.501Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e75c732aeefd238294740983","created_at":"2026-10-17T17:25:02.787Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-71e76ed6090d42c4","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.803Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e75c732aeefd238294740983: done: 0.037329 sec","job_status":"done","queue_duration_s":0.660314,"scheduling_latency_s":0.66035,"redis_calls":10,"redis_duration_s":0.003617,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002755,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037329,"completed_at":"2026-10-17T17:25:03.501Z","load_balancing_strategy":"primary","db_duration_s":0.002793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 142.971718] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.503Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6a3c483fb98af37366ab50ba","created_at":"2026-10-17T17:25:02.787Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-71e76ed6090d42c4","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.803Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6a3c483fb98af37366ab50ba: start","job_status":"start","queue_duration_s":0.699847,"scheduling_latency_s":0.699877}1357gitlab # [ 142.989363] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.521Z","message":"No existing merge request to be cleaned up."}1358gitlab # [ 142.998439] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.530Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6a3c483fb98af37366ab50ba","created_at":"2026-10-17T17:25:02.787Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-71e76ed6090d42c4","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.803Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6a3c483fb98af37366ab50ba: done: 0.026668 sec","job_status":"done","queue_duration_s":0.699847,"scheduling_latency_s":0.699877,"redis_calls":10,"redis_duration_s":0.0024879999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001473,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026668,"completed_at":"2026-10-17T17:25:03.530Z","load_balancing_strategy":"primary","db_duration_s":0.002142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 143.011448] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.532Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f99395c9a54ea83f569b58d","created_at":"2026-10-17T17:25:02.787Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-71e76ed6090d42c4","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.803Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f99395c9a54ea83f569b58d: start","job_status":"start","queue_duration_s":0.728377,"scheduling_latency_s":0.728401}1360gitlab # [ 143.023094] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.541Z","message":"No existing merge request to be cleaned up."}1361gitlab # [ 143.060375] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.547Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f99395c9a54ea83f569b58d","created_at":"2026-10-17T17:25:02.787Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-71e76ed6090d42c4","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"85be6e374ad69471061a0ab0126db1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.803Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f99395c9a54ea83f569b58d: done: 0.015311 sec","job_status":"done","queue_duration_s":0.728377,"scheduling_latency_s":0.728401,"redis_calls":10,"redis_duration_s":0.001304,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015311,"completed_at":"2026-10-17T17:25:03.547Z","load_balancing_strategy":"primary","db_duration_s":0.00442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 143.061729] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7be943b85768992ef02190e9","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7be943b85768992ef02190e9: start","job_status":"start","queue_duration_s":0.552753,"scheduling_latency_s":0.552767}1363gitlab # [ 143.068120] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7be943b85768992ef02190e9","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7be943b85768992ef02190e9: done: 0.015066 sec","job_status":"done","queue_duration_s":0.552753,"scheduling_latency_s":0.552767,"redis_calls":16,"redis_duration_s":0.001987,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204775,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015066,"completed_at":"2026-10-17T17:25:03.563Z","load_balancing_strategy":"primary","db_duration_s":0.001043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 143.105701] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e97bac235b22f7267e8d8f47","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e97bac235b22f7267e8d8f47: start","job_status":"start","queue_duration_s":0.568855,"scheduling_latency_s":0.568868}1365gitlab # [ 143.144280] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e97bac235b22f7267e8d8f47","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e97bac235b22f7267e8d8f47: done: 0.00969 sec","job_status":"done","queue_duration_s":0.568855,"scheduling_latency_s":0.568868,"redis_calls":13,"redis_duration_s":0.0016220000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00969,"completed_at":"2026-10-17T17:25:03.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 143.149959] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9981e6b93719a5552f559d07","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9981e6b93719a5552f559d07: start","job_status":"start","queue_duration_s":0.579504,"scheduling_latency_s":0.579518}1367gitlab # [ 143.192149] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9981e6b93719a5552f559d07","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9981e6b93719a5552f559d07: done: 0.00951 sec","job_status":"done","queue_duration_s":0.579504,"scheduling_latency_s":0.579518,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00951,"completed_at":"2026-10-17T17:25:03.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 143.194103] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df1e58cec2091a3d572910b2","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df1e58cec2091a3d572910b2: start","job_status":"start","queue_duration_s":0.58998,"scheduling_latency_s":0.589992}1369gitlab # [ 143.241567] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df1e58cec2091a3d572910b2","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df1e58cec2091a3d572910b2: done: 0.009624 sec","job_status":"done","queue_duration_s":0.58998,"scheduling_latency_s":0.589992,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009624,"completed_at":"2026-10-17T17:25:03.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 143.242372] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dcb04621ad168ec2bfaf947","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dcb04621ad168ec2bfaf947: start","job_status":"start","queue_duration_s":0.600563,"scheduling_latency_s":0.600576}1371gitlab # [ 143.249240] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dcb04621ad168ec2bfaf947","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dcb04621ad168ec2bfaf947: done: 0.009587 sec","job_status":"done","queue_duration_s":0.600563,"scheduling_latency_s":0.600576,"redis_calls":13,"redis_duration_s":0.001534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009587,"completed_at":"2026-10-17T17:25:03.605Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 143.298746] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d2b00d1941ba985d5757602","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d2b00d1941ba985d5757602: start","job_status":"start","queue_duration_s":0.611085,"scheduling_latency_s":0.611097}1373gitlab # [ 143.299616] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d2b00d1941ba985d5757602","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d2b00d1941ba985d5757602: done: 0.009449 sec","job_status":"done","queue_duration_s":0.611085,"scheduling_latency_s":0.611097,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009449,"completed_at":"2026-10-17T17:25:03.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 143.342986] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c7c759c4e6478acb3e358d0","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c7c759c4e6478acb3e358d0: start","job_status":"start","queue_duration_s":0.621503,"scheduling_latency_s":0.621516}1375gitlab # [ 143.343669] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c7c759c4e6478acb3e358d0","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c7c759c4e6478acb3e358d0: done: 0.009359 sec","job_status":"done","queue_duration_s":0.621503,"scheduling_latency_s":0.621516,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009359,"completed_at":"2026-10-17T17:25:03.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 143.403967] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"724c4f932d9a7553928fc7cf","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-724c4f932d9a7553928fc7cf: start","job_status":"start","queue_duration_s":0.631652,"scheduling_latency_s":0.631665}1377gitlab # [ 143.404820] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"724c4f932d9a7553928fc7cf","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-724c4f932d9a7553928fc7cf: done: 0.009401 sec","job_status":"done","queue_duration_s":0.631652,"scheduling_latency_s":0.631665,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009401,"completed_at":"2026-10-17T17:25:03.636Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 143.459969] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4df483c39cd61d5ca0579eb7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4df483c39cd61d5ca0579eb7: start","job_status":"start","queue_duration_s":0.642009,"scheduling_latency_s":0.642023}1379gitlab # [ 143.460834] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4df483c39cd61d5ca0579eb7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4df483c39cd61d5ca0579eb7: done: 0.009469 sec","job_status":"done","queue_duration_s":0.642009,"scheduling_latency_s":0.642023,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009469,"completed_at":"2026-10-17T17:25:03.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 143.504290] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a18267ebbf3aebdcf62a18f8","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a18267ebbf3aebdcf62a18f8: start","job_status":"start","queue_duration_s":0.652333,"scheduling_latency_s":0.652347}1381gitlab # [ 143.505190] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a18267ebbf3aebdcf62a18f8","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a18267ebbf3aebdcf62a18f8: done: 0.009545 sec","job_status":"done","queue_duration_s":0.652333,"scheduling_latency_s":0.652347,"redis_calls":13,"redis_duration_s":0.001655,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009545,"completed_at":"2026-10-17T17:25:03.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 143.530970] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"307d17cbb3e2743f4ed15e1c","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-307d17cbb3e2743f4ed15e1c: start","job_status":"start","queue_duration_s":0.662703,"scheduling_latency_s":0.662741}1383gitlab # [ 143.543294] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"307d17cbb3e2743f4ed15e1c","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-307d17cbb3e2743f4ed15e1c: done: 0.010014 sec","job_status":"done","queue_duration_s":0.662703,"scheduling_latency_s":0.662741,"redis_calls":13,"redis_duration_s":0.001646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010014,"completed_at":"2026-10-17T17:25:03.668Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 143.592727] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"beda1676c072edea16b3bd23","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-beda1676c072edea16b3bd23: start","job_status":"start","queue_duration_s":0.673528,"scheduling_latency_s":0.67354}1385gitlab # [ 143.593543] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"beda1676c072edea16b3bd23","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-beda1676c072edea16b3bd23: done: 0.009632 sec","job_status":"done","queue_duration_s":0.673528,"scheduling_latency_s":0.67354,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009632,"completed_at":"2026-10-17T17:25:03.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 143.640673] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a65675ec2d7972d41d13622","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a65675ec2d7972d41d13622: start","job_status":"start","queue_duration_s":0.683966,"scheduling_latency_s":0.683979}1387gitlab # [ 143.641518] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a65675ec2d7972d41d13622","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a65675ec2d7972d41d13622: done: 0.009361 sec","job_status":"done","queue_duration_s":0.683966,"scheduling_latency_s":0.683979,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009361,"completed_at":"2026-10-17T17:25:03.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 143.685093] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcff90377231985c114f2f36","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcff90377231985c114f2f36: start","job_status":"start","queue_duration_s":0.694278,"scheduling_latency_s":0.69429}1389gitlab # [ 143.690256] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcff90377231985c114f2f36","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcff90377231985c114f2f36: done: 0.009366 sec","job_status":"done","queue_duration_s":0.694278,"scheduling_latency_s":0.69429,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009366,"completed_at":"2026-10-17T17:25:03.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 143.737704] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97b6f98adf5861f36de7e9a4","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97b6f98adf5861f36de7e9a4: start","job_status":"start","queue_duration_s":0.704622,"scheduling_latency_s":0.704634}1391gitlab # [ 143.739579] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97b6f98adf5861f36de7e9a4","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97b6f98adf5861f36de7e9a4: done: 0.009526 sec","job_status":"done","queue_duration_s":0.704622,"scheduling_latency_s":0.704634,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009526,"completed_at":"2026-10-17T17:25:03.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 143.785836] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a9cade2f9996bd83fdde8b5","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a9cade2f9996bd83fdde8b5: start","job_status":"start","queue_duration_s":0.715102,"scheduling_latency_s":0.715116}1393gitlab # [ 143.788603] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a9cade2f9996bd83fdde8b5","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a9cade2f9996bd83fdde8b5: done: 0.009462 sec","job_status":"done","queue_duration_s":0.715102,"scheduling_latency_s":0.715116,"redis_calls":13,"redis_duration_s":0.0016060000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009462,"completed_at":"2026-10-17T17:25:03.720Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 143.830751] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37292c4c0b08f8cec8730f86","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37292c4c0b08f8cec8730f86: start","job_status":"start","queue_duration_s":0.725551,"scheduling_latency_s":0.725564}1395gitlab # [ 143.873267] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37292c4c0b08f8cec8730f86","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37292c4c0b08f8cec8730f86: done: 0.009533 sec","job_status":"done","queue_duration_s":0.725551,"scheduling_latency_s":0.725564,"redis_calls":13,"redis_duration_s":0.0014789999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009533,"completed_at":"2026-10-17T17:25:03.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 143.874736] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a7e6a971ed998119feac39e","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a7e6a971ed998119feac39e: start","job_status":"start","queue_duration_s":0.736085,"scheduling_latency_s":0.736098}1397gitlab # [ 143.920589] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a7e6a971ed998119feac39e","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a7e6a971ed998119feac39e: done: 0.009376 sec","job_status":"done","queue_duration_s":0.736085,"scheduling_latency_s":0.736098,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009376,"completed_at":"2026-10-17T17:25:03.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 143.923715] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f465c8ee36a22bca2dfae11","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f465c8ee36a22bca2dfae11: start","job_status":"start","queue_duration_s":0.7465,"scheduling_latency_s":0.746513}1399gitlab # [ 143.974516] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f465c8ee36a22bca2dfae11","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f465c8ee36a22bca2dfae11: done: 0.009593 sec","job_status":"done","queue_duration_s":0.7465,"scheduling_latency_s":0.746513,"redis_calls":13,"redis_duration_s":0.001639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009593,"completed_at":"2026-10-17T17:25:03.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 143.976078] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"846eb44d45465ed3ce752d13","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-846eb44d45465ed3ce752d13: start","job_status":"start","queue_duration_s":0.756926,"scheduling_latency_s":0.756938}1401gitlab # [ 144.025098] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"846eb44d45465ed3ce752d13","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-846eb44d45465ed3ce752d13: done: 0.009553 sec","job_status":"done","queue_duration_s":0.756926,"scheduling_latency_s":0.756938,"redis_calls":13,"redis_duration_s":0.001576,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009553,"completed_at":"2026-10-17T17:25:03.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 144.026629] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2610e953e16b1e7cc59e7a26","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2610e953e16b1e7cc59e7a26: start","job_status":"start","queue_duration_s":0.767321,"scheduling_latency_s":0.767333}1403gitlab # [ 144.034718] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2610e953e16b1e7cc59e7a26","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2610e953e16b1e7cc59e7a26: done: 0.056861 sec","job_status":"done","queue_duration_s":0.767321,"scheduling_latency_s":0.767333,"redis_calls":13,"redis_duration_s":0.001718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.056861,"completed_at":"2026-10-17T17:25:03.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 144.095792] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b877a51017b5f5c414dfb421","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b877a51017b5f5c414dfb421: start","job_status":"start","queue_duration_s":0.825127,"scheduling_latency_s":0.825144}1405gitlab # [ 144.096880] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b877a51017b5f5c414dfb421","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b877a51017b5f5c414dfb421: done: 0.009818 sec","job_status":"done","queue_duration_s":0.825127,"scheduling_latency_s":0.825144,"redis_calls":13,"redis_duration_s":0.00155,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009818,"completed_at":"2026-10-17T17:25:03.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 144.160239] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1342d6ed02a04979536a170","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1342d6ed02a04979536a170: start","job_status":"start","queue_duration_s":0.835756,"scheduling_latency_s":0.835769}1407gitlab # [ 144.161145] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1342d6ed02a04979536a170","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1342d6ed02a04979536a170: done: 0.009247 sec","job_status":"done","queue_duration_s":0.835756,"scheduling_latency_s":0.835769,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009247,"completed_at":"2026-10-17T17:25:03.840Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 144.203214] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69de44c8be0fd990ac20e47c","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69de44c8be0fd990ac20e47c: start","job_status":"start","queue_duration_s":0.845833,"scheduling_latency_s":0.845846}1409gitlab # [ 144.203961] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69de44c8be0fd990ac20e47c","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69de44c8be0fd990ac20e47c: done: 0.00904 sec","job_status":"done","queue_duration_s":0.845833,"scheduling_latency_s":0.845846,"redis_calls":13,"redis_duration_s":0.0015429999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00904,"completed_at":"2026-10-17T17:25:03.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 144.216845] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5539d4f18e2bc18d9cd1d4d7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5539d4f18e2bc18d9cd1d4d7: start","job_status":"start","queue_duration_s":0.855642,"scheduling_latency_s":0.855654}1411gitlab # [ 144.261392] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5539d4f18e2bc18d9cd1d4d7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5539d4f18e2bc18d9cd1d4d7: done: 0.009004 sec","job_status":"done","queue_duration_s":0.855642,"scheduling_latency_s":0.855654,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009004,"completed_at":"2026-10-17T17:25:03.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 144.262675] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2ba00579c48e1fc7c52e597","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2ba00579c48e1fc7c52e597: start","job_status":"start","queue_duration_s":0.865483,"scheduling_latency_s":0.865496}1413gitlab # [ 144.272775] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2ba00579c48e1fc7c52e597","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2ba00579c48e1fc7c52e597: done: 0.009338 sec","job_status":"done","queue_duration_s":0.865483,"scheduling_latency_s":0.865496,"redis_calls":13,"redis_duration_s":0.001716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009338,"completed_at":"2026-10-17T17:25:03.870Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 144.309270] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ab6a5ff2b398bc0d9487093","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ab6a5ff2b398bc0d9487093: start","job_status":"start","queue_duration_s":0.876029,"scheduling_latency_s":0.876042}1415gitlab # [ 144.321524] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ab6a5ff2b398bc0d9487093","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ab6a5ff2b398bc0d9487093: done: 0.009056 sec","job_status":"done","queue_duration_s":0.876029,"scheduling_latency_s":0.876042,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009056,"completed_at":"2026-10-17T17:25:03.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 144.364551] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b55c89cf24823334a355b7f","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b55c89cf24823334a355b7f: start","job_status":"start","queue_duration_s":0.885894,"scheduling_latency_s":0.885907}1417gitlab # [ 144.370253] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b55c89cf24823334a355b7f","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b55c89cf24823334a355b7f: done: 0.009105 sec","job_status":"done","queue_duration_s":0.885894,"scheduling_latency_s":0.885907,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009105,"completed_at":"2026-10-17T17:25:03.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 144.423660] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"219d44b2521bd82301e3a5f7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-219d44b2521bd82301e3a5f7: start","job_status":"start","queue_duration_s":0.895844,"scheduling_latency_s":0.895857}1419gitlab # [ 144.424478] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"219d44b2521bd82301e3a5f7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-219d44b2521bd82301e3a5f7: done: 0.009081 sec","job_status":"done","queue_duration_s":0.895844,"scheduling_latency_s":0.895857,"redis_calls":13,"redis_duration_s":0.0014969999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009081,"completed_at":"2026-10-17T17:25:03.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 144.484191] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54938975ea7c28f15adb1504","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54938975ea7c28f15adb1504: start","job_status":"start","queue_duration_s":0.905773,"scheduling_latency_s":0.905785}1421gitlab # [ 144.484876] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54938975ea7c28f15adb1504","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54938975ea7c28f15adb1504: done: 0.009044 sec","job_status":"done","queue_duration_s":0.905773,"scheduling_latency_s":0.905785,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009044,"completed_at":"2026-10-17T17:25:03.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 144.537540] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bacdb9d6813ea9ebf8b580a","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bacdb9d6813ea9ebf8b580a: start","job_status":"start","queue_duration_s":0.916115,"scheduling_latency_s":0.916129}1423gitlab # [ 144.538231] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bacdb9d6813ea9ebf8b580a","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bacdb9d6813ea9ebf8b580a: done: 0.009119 sec","job_status":"done","queue_duration_s":0.916115,"scheduling_latency_s":0.916129,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009119,"completed_at":"2026-10-17T17:25:03.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 144.555569] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"852d15a02278e181e2bf656d","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-852d15a02278e181e2bf656d: start","job_status":"start","queue_duration_s":0.92607,"scheduling_latency_s":0.926083}1425gitlab # [ 144.601185] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"852d15a02278e181e2bf656d","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-852d15a02278e181e2bf656d: done: 0.009009 sec","job_status":"done","queue_duration_s":0.92607,"scheduling_latency_s":0.926083,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009009,"completed_at":"2026-10-17T17:25:03.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 144.604158] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d544e8d7139a570dd03caa3","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d544e8d7139a570dd03caa3: start","job_status":"start","queue_duration_s":0.93595,"scheduling_latency_s":0.935963}1427gitlab # [ 144.616033] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d544e8d7139a570dd03caa3","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d544e8d7139a570dd03caa3: done: 0.009116 sec","job_status":"done","queue_duration_s":0.93595,"scheduling_latency_s":0.935963,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009116,"completed_at":"2026-10-17T17:25:03.940Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 144.685945] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3edbe879281e46b12ecf2ed7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3edbe879281e46b12ecf2ed7: start","job_status":"start","queue_duration_s":0.945901,"scheduling_latency_s":0.945913}1429gitlab # [ 144.686769] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3edbe879281e46b12ecf2ed7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3edbe879281e46b12ecf2ed7: done: 0.009087 sec","job_status":"done","queue_duration_s":0.945901,"scheduling_latency_s":0.945913,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009087,"completed_at":"2026-10-17T17:25:03.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 144.703503] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fa1409af2ab11b2e7c60e7f","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fa1409af2ab11b2e7c60e7f: start","job_status":"start","queue_duration_s":0.956237,"scheduling_latency_s":0.95625}1431gitlab # [ 144.715562] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fa1409af2ab11b2e7c60e7f","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fa1409af2ab11b2e7c60e7f: done: 0.009049 sec","job_status":"done","queue_duration_s":0.956237,"scheduling_latency_s":0.95625,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009049,"completed_at":"2026-10-17T17:25:03.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 144.773741] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ca51829846382cdd03799c7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ca51829846382cdd03799c7: start","job_status":"start","queue_duration_s":0.96608,"scheduling_latency_s":0.966093}1433gitlab # [ 144.774660] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ca51829846382cdd03799c7","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ca51829846382cdd03799c7: done: 0.00941 sec","job_status":"done","queue_duration_s":0.96608,"scheduling_latency_s":0.966093,"redis_calls":13,"redis_duration_s":0.001678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00941,"completed_at":"2026-10-17T17:25:03.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 144.824744] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:03.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a8fd7ab2535b337bbaa5452","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a8fd7ab2535b337bbaa5452: start","job_status":"start","queue_duration_s":0.976279,"scheduling_latency_s":0.976292}1435gitlab # [ 144.825723] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a8fd7ab2535b337bbaa5452","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a8fd7ab2535b337bbaa5452: done: 0.032288 sec","job_status":"done","queue_duration_s":0.976279,"scheduling_latency_s":0.976292,"redis_calls":13,"redis_duration_s":0.0015539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032288,"completed_at":"2026-10-17T17:25:04.004Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 144.874707] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"084ece370898c0ee211552bb","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-084ece370898c0ee211552bb: start","job_status":"start","queue_duration_s":1.009842,"scheduling_latency_s":1.009856}1437gitlab # [ 144.875665] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"084ece370898c0ee211552bb","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-084ece370898c0ee211552bb: done: 0.00936 sec","job_status":"done","queue_duration_s":1.009842,"scheduling_latency_s":1.009856,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00936,"completed_at":"2026-10-17T17:25:04.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 144.900205] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cadb4655f23d8d66c0d1d8d9","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cadb4655f23d8d66c0d1d8d9: start","job_status":"start","queue_duration_s":1.019992,"scheduling_latency_s":1.020005}1439gitlab # [ 144.912227] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cadb4655f23d8d66c0d1d8d9","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cadb4655f23d8d66c0d1d8d9: done: 0.009509 sec","job_status":"done","queue_duration_s":1.019992,"scheduling_latency_s":1.020005,"redis_calls":13,"redis_duration_s":0.002125,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001641,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009509,"completed_at":"2026-10-17T17:25:04.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 144.972775] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eea2f0b27b005f5889e42c95","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eea2f0b27b005f5889e42c95: start","job_status":"start","queue_duration_s":1.030334,"scheduling_latency_s":1.030346}1441gitlab # [ 144.973645] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eea2f0b27b005f5889e42c95","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eea2f0b27b005f5889e42c95: done: 0.009295 sec","job_status":"done","queue_duration_s":1.030334,"scheduling_latency_s":1.030346,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009295,"completed_at":"2026-10-17T17:25:04.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 145.023768] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50a9843a1646b341b399c9fc","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50a9843a1646b341b399c9fc: start","job_status":"start","queue_duration_s":1.040465,"scheduling_latency_s":1.040478}1443gitlab # [ 145.024707] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50a9843a1646b341b399c9fc","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50a9843a1646b341b399c9fc: done: 0.009375 sec","job_status":"done","queue_duration_s":1.040465,"scheduling_latency_s":1.040478,"redis_calls":13,"redis_duration_s":0.001502,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009375,"completed_at":"2026-10-17T17:25:04.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 145.048196] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"950697e24922cac066f1d730","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-950697e24922cac066f1d730: start","job_status":"start","queue_duration_s":1.051239,"scheduling_latency_s":1.051252}1445gitlab # [ 145.060038] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"950697e24922cac066f1d730","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-950697e24922cac066f1d730: done: 0.009356 sec","job_status":"done","queue_duration_s":1.051239,"scheduling_latency_s":1.051252,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009356,"completed_at":"2026-10-17T17:25:04.056Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 145.126186] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"195e45ba812fc45d599a755c","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-195e45ba812fc45d599a755c: start","job_status":"start","queue_duration_s":1.061462,"scheduling_latency_s":1.061476}1447gitlab # [ 145.126863] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"195e45ba812fc45d599a755c","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-195e45ba812fc45d599a755c: done: 0.009601 sec","job_status":"done","queue_duration_s":1.061462,"scheduling_latency_s":1.061476,"redis_calls":13,"redis_duration_s":0.002099,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009601,"completed_at":"2026-10-17T17:25:04.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 145.138132] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a35b856a498eda6419747198","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a35b856a498eda6419747198: start","job_status":"start","queue_duration_s":1.071871,"scheduling_latency_s":1.071884}1449gitlab # [ 145.175996] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a35b856a498eda6419747198","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a35b856a498eda6419747198: done: 0.009082 sec","job_status":"done","queue_duration_s":1.071871,"scheduling_latency_s":1.071884,"redis_calls":13,"redis_duration_s":0.0015049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009082,"completed_at":"2026-10-17T17:25:04.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 145.215081] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"574a886d8974e18f0c06883b","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-574a886d8974e18f0c06883b: start","job_status":"start","queue_duration_s":1.081828,"scheduling_latency_s":1.081841}1451gitlab # [ 145.215895] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"574a886d8974e18f0c06883b","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-574a886d8974e18f0c06883b: done: 0.009547 sec","job_status":"done","queue_duration_s":1.081828,"scheduling_latency_s":1.081841,"redis_calls":13,"redis_duration_s":0.0015480000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009547,"completed_at":"2026-10-17T17:25:04.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 145.260204] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76369983524484d217b49af0","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76369983524484d217b49af0: start","job_status":"start","queue_duration_s":1.092176,"scheduling_latency_s":1.092188}1453gitlab # [ 145.260963] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76369983524484d217b49af0","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76369983524484d217b49af0: done: 0.009051 sec","job_status":"done","queue_duration_s":1.092176,"scheduling_latency_s":1.092188,"redis_calls":13,"redis_duration_s":0.0018419999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001365,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009051,"completed_at":"2026-10-17T17:25:04.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 145.300071] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4626f62bd7088d7da1792424","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4626f62bd7088d7da1792424: start","job_status":"start","queue_duration_s":1.102038,"scheduling_latency_s":1.10205}1455gitlab # [ 145.300789] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4626f62bd7088d7da1792424","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4626f62bd7088d7da1792424: done: 0.008973 sec","job_status":"done","queue_duration_s":1.102038,"scheduling_latency_s":1.10205,"redis_calls":13,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008973,"completed_at":"2026-10-17T17:25:04.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 145.314960] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8934e6e9cfa238d158596d0d","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8934e6e9cfa238d158596d0d: start","job_status":"start","queue_duration_s":1.1118,"scheduling_latency_s":1.111813}1457gitlab # [ 145.355160] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8934e6e9cfa238d158596d0d","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8934e6e9cfa238d158596d0d: done: 0.009386 sec","job_status":"done","queue_duration_s":1.1118,"scheduling_latency_s":1.111813,"redis_calls":13,"redis_duration_s":0.0014950000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009386,"completed_at":"2026-10-17T17:25:04.116Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 145.394101] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"476c12fe17ffea03e09d4f2f","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-476c12fe17ffea03e09d4f2f: start","job_status":"start","queue_duration_s":1.122007,"scheduling_latency_s":1.122019}1459gitlab # [ 145.394815] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"476c12fe17ffea03e09d4f2f","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-476c12fe17ffea03e09d4f2f: done: 0.009168 sec","job_status":"done","queue_duration_s":1.122007,"scheduling_latency_s":1.122019,"redis_calls":13,"redis_duration_s":0.0019140000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001422,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009168,"completed_at":"2026-10-17T17:25:04.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 145.437236] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2df0976cb75c0a9510b6aacd","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2df0976cb75c0a9510b6aacd: start","job_status":"start","queue_duration_s":1.131988,"scheduling_latency_s":1.132001}1461gitlab # [ 145.437934] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:04.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2df0976cb75c0a9510b6aacd","created_at":"2026-10-17T17:25:02.933Z","trace_propagation_headers":{"sentry-trace":"67c18ddf02e54dd0b2718a87abcd45e4-4bcaa4e3d7334204","baggage":"sentry-trace_id=67c18ddf02e54dd0b2718a87abcd45e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"37321cc5356cd150ea5cc936d91bfa7b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:02.995Z","job_size_bytes":2,"pid":1588,"sidekiq_tid":"mag0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2df0976cb75c0a9510b6aacd: done: 0.009104 sec","job_status":"done","queue_duration_s":1.131988,"scheduling_latency_s":1.132001,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009104,"completed_at":"2026-10-17T17:25:04.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 145.630707] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1225164822 wd_nsec: 12251643851463gitlab # [ 156.274802] setup-gitlab-start[2202]: W, [2026-10-17T17:25:16.806348 #2202] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1464gitlab # [ 176.098073] postgres[2390]: [2390] ERROR: relation "table_without_models" does not exist1465gitlab # [ 176.098342] postgres[2390]: [2390] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1466gitlab # [ 178.854264] runuser[2201]: pam_unix(runuser:session): session closed for user gitlab1467gitlab # [ 178.855741] setup-gitlab-start[2183]: + systemctl restart gitlab-sidekiq.service1468gitlab # [ 178.874192] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:39.405Z","message":"Shutting down"}1469gitlab # [ 178.875520] systemd[1]: Stopping gitlab-sidekiq.service...1470gitlab # [ 178.877304] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:39.408Z","message":"Scheduler exiting..."}1471gitlab # [ 178.880463] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:39.412Z","message":"Terminating quiet threads for default capsule"}1472gitlab # [ 178.884312] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:39.416Z","message":"Scheduler exiting..."}1473gitlab # [ 179.389141] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:39.920Z","message":"Pausing to allow jobs to finish..."}1474gitlab # [ 184.391912] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:44.923Z","message":"Bye!"}1475gitlab # [ 184.404716] sidekiq-cluster[1588]: {"severity":"INFO","time":"2026-10-17T17:25:44.936Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1588,"worker_id":"sidekiq_0","memwd_rss_bytes":939630592,"retry":0}1476gitlab # [ 185.076904] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1477gitlab # [ 185.077838] systemd[1]: Stopped gitlab-sidekiq.service.1478gitlab # [ 185.078689] systemd[1]: gitlab-sidekiq.service: Consumed 56.604s CPU time over 1min 56.022s wall clock time, 958.1M memory peak, 4.4M read from disk.1479gitlab # [ 185.081921] systemd[1]: Started gitlab-sidekiq.service.1480gitlab # [ 185.084162] setup-gitlab-start[2183]: + mkdir -p /var/lib/secrets1481gitlab # [ 185.086528] setup-gitlab-start[2183]: + echo nixbot-test-token-of-20-chars1482gitlab # [ 185.087541] setup-gitlab-start[2183]: + chmod 644 /var/lib/secrets/gitlab-token1483gitlab # [ 185.090806] setup-gitlab-start[2183]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1484gitlab # [ 185.338868] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:45 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 2231485gitlab # [ 185.823479] gitaly[913]: time="2026-10-17T17:25:46.355Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.354" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1486gitlab # [ 185.847585] gitaly[913]: time="2026-10-17T17:25:46.355Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.354" grpc.time_ms=0.42 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1487gitlab # [ 185.992781] gitaly[913]: time="2026-10-17T17:25:46.524Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.174" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.524" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 185.993172] gitaly[913]: time="2026-10-17T17:25:46.525Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.174" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.524" grpc.time_ms=0.378 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 186.045791] gitaly[913]: time="2026-10-17T17:25:46.578Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN diskcache=69e58713-e71a-4ad6-a799-a98b275f36b9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-17T17:25:56.181" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.531" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 186.065465] gitaly[913]: time="2026-10-17T17:25:46.597Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-17T17:25:56.181" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.531" grpc.time_ms=46.967 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 186.082343] gitaly[913]: time="2026-10-17T17:25:46.606Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.255" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.605" pid=913 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1492gitlab # [ 186.082868] gitaly[913]: time="2026-10-17T17:25:46.607Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.255" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.605" grpc.time_ms=1.023 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 186.102099] gitaly[913]: time="2026-10-17T17:25:46.634Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T17:25:56.259" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.609" grpc.time_ms=24.698 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 186.162909] gitaly[913]: time="2026-10-17T17:25:46.695Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.694" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 186.175385] gitaly[913]: time="2026-10-17T17:25:46.707Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.694" grpc.time_ms=0.294 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 186.221950] gitaly[913]: time="2026-10-17T17:25:46.754Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN diskcache=c2ca5a1c-4e5e-43ee-aa00-21e3530914d6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-17T17:25:56.028" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.718" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 186.222472] gitaly[913]: time="2026-10-17T17:25:46.754Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1568 command.oublock=32 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-17T17:25:56.028" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.718" grpc.time_ms=35.409 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 186.244076] gitaly[913]: time="2026-10-17T17:25:46.776Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.085" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.775" pid=913 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1499gitlab # [ 186.245620] gitaly[913]: time="2026-10-17T17:25:46.776Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.085" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.775" grpc.time_ms=0.387 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1500gitlab # [ 186.259075] gitaly[913]: time="2026-10-17T17:25:46.791Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T17:25:56.091" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.781" grpc.time_ms=9.381 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1501gitlab # [ 186.289535] gitaly[913]: time="2026-10-17T17:25:46.821Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:25:56.130" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.821" grpc.time_ms=0.252 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1502gitlab # [ 186.300426] gitaly[913]: time="2026-10-17T17:25:46.832Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-17T17:25:56.142" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:46.832" grpc.time_ms=0.21 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1503gitlab # [ 186.730991] gitaly[913]: time="2026-10-17T17:25:47.263Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EBW8SHAKTAGBAQ3F34HVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T17:25:57.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:47.252" grpc.time_ms=10.743 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1504gitlab # [ 186.984486] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:47 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 16341505gitlab # [ 186.990791] setup-gitlab-start[2448]: {"id":1,"message":null,"error":null}1506gitlab # [ 188.059818] sidekiq-cluster[2436]: {"severity":"INFO","time":"2026-10-17T17:25:48.575Z","message":"Starting cluster with 1 processes"}1507gitlab # [ 192.312619] gitaly[913]: time="2026-10-17T17:25:52.844Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC2S2GGA0D58B4X0XF61A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T17:26:02.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:52.834" grpc.time_ms=9.702 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1508gitlab # [ 192.762161] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:53 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 7471509gitlab # [ 192.765204] setup-gitlab-start[2183]: + mkdir -p /tmp/test-flake1510gitlab # [ 192.767205] setup-gitlab-start[2183]: + cd /tmp/test-flake1511gitlab # [ 192.767460] setup-gitlab-start[2183]: + git init -b master1512gitlab # [ 192.792387] setup-gitlab-start[2536]: Initialized empty Git repository in /tmp/test-flake/.git/1513gitlab # [ 192.793060] setup-gitlab-start[2183]: + git config user.name test1514gitlab # [ 192.795841] setup-gitlab-start[2183]: + git config user.email test@example.com1515gitlab # [ 192.799353] setup-gitlab-start[2183]: + cat1516gitlab # [ 192.801215] setup-gitlab-start[2183]: + git add flake.nix1517gitlab # [ 192.803568] setup-gitlab-start[2183]: + git commit -m 'initial commit'1518gitlab # [ 192.820725] setup-gitlab-start[2541]: [master (root-commit) e2f11a4] initial commit1519gitlab # [ 192.822467] setup-gitlab-start[2541]: 1 file changed, 10 insertions(+)1520gitlab # [ 192.823000] setup-gitlab-start[2541]: create mode 100644 flake.nix1521gitlab # [ 192.823728] setup-gitlab-start[2183]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1522gitlab # [ 192.829371] setup-gitlab-start[2183]: + git push -u origin master1523gitlab # [ 192.907663] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 491524gitlab # [ 193.045261] gitaly[913]: time="2026-10-17T17:25:53.577Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3N2X88KG5DSC9YA3M1G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:53.564" grpc.time_ms=12.421 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1525gitlab # [ 193.046920] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1361526gitlab # [ 193.238501] gitaly[913]: time="2026-10-17T17:25:53.770Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T17:26:03.069" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:53.759" grpc.time_ms=10.49 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1527gitlab # [ 193.266157] gitaly[913]: time="2026-10-17T17:25:53.798Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-17T17:26:23.091" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-17T17:25:53.791" grpc.time_ms=6.512 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1528gitlab # [ 193.279660] gitaly[913]: time="2026-10-17T17:25:53.811Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX duration_ms=100ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/allowed"1529gitlab # [ 193.310219] gitaly[913]: time="2026-10-17T17:25:53.842Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX duration_ms=29ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/pre_receive"1530gitlab # [ 193.313482] gitaly[913]: time="2026-10-17T17:25:53.845Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:25:53.711" grpc.time_ms=134.332 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1531gitlab # [ 193.342468] gitaly[913]: time="2026-10-17T17:25:53.874Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:25:53.874" grpc.time_ms=0.448 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1532gitlab # [ 193.383421] gitaly[913]: time="2026-10-17T17:25:53.915Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:25:53.914" grpc.time_ms=0.671 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1533gitlab # [ 193.424830] gitaly[913]: time="2026-10-17T17:25:53.957Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:25:53.956" grpc.time_ms=0.438 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1534gitlab # [ 193.494168] gitaly[913]: time="2026-10-17T17:25:54.026Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T17:26:04.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:54.019" grpc.time_ms=6.472 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 193.516457] gitaly[913]: time="2026-10-17T17:25:54.048Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1557 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-17T17:26:04.020" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:25:54.031" grpc.time_ms=16.377 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1536gitlab # [ 193.523168] gitaly[913]: time="2026-10-17T17:25:54.055Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX duration_ms=69ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/post_receive"1537gitlab # [ 193.523904] gitaly[913]: time="2026-10-17T17:25:54.056Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:25:53.985" grpc.time_ms=70.995 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1538gitlab # [ 193.550920] gitaly[913]: time="2026-10-17T17:25:54.083Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX diskcache=bac56232-4b45-4e72-b339-f1ee9ee3c63c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:53.647" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1539gitlab # [ 193.560663] gitlab-workhorse[827]: time="2026-10-17T17:25:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521540gitlab # [ 193.560917] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:54 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4921541gitlab # [ 193.561763] setup-gitlab-start[2545]: To http://gitlab/root/test-flake.git1542gitlab # [ 193.562163] setup-gitlab-start[2545]: * [new branch] master -> master1543gitlab # [ 193.562648] gitaly[913]: time="2026-10-17T17:25:54.083Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=176 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13633 command.oublock=32 command.real_time_ms=425 command.spawn_token_fork_ms=0 command.system_time_ms=111 command.user_time_ms=65 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:53.647" grpc.time_ms=435.979 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1544gitlab # [ 193.580653] setup-gitlab-start[2545]: branch 'master' set up to track 'origin/master'.1545gitlab # [ 193.584049] systemd[1]: Finished setup-gitlab.service.1546gitlab # [ 193.587366] systemd[1]: Starting nixbot CI service...1547gitlab: (finished: waiting for unit setup-gitlab.service, in 194.31 seconds)1548gitlab: waiting for unit nixbot.service1549gitlab # [ 194.645199] nixbot[2618]: {"ts": "2026-10-17T17:25:55.177Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1550gitlab # [ 194.666252] nixbot[2618]: {"ts": "2026-10-17T17:25:55.198Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1551gitlab # [ 194.696720] nixbot[2618]: {"ts": "2026-10-17T17:25:55.228Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1552gitlab # [ 194.706583] nixbot[2618]: {"ts": "2026-10-17T17:25:55.238Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1553gitlab # [ 194.715267] nixbot[2618]: {"ts": "2026-10-17T17:25:55.247Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1554gitlab # [ 194.720045] nixbot[2618]: {"ts": "2026-10-17T17:25:55.251Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1555gitlab # [ 194.721501] nixbot[2618]: {"ts": "2026-10-17T17:25:55.253Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1556gitlab # [ 194.723052] nixbot[2618]: {"ts": "2026-10-17T17:25:55.255Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1557gitlab # [ 194.727036] nixbot[2618]: {"ts": "2026-10-17T17:25:55.259Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1558gitlab # [ 194.728638] nixbot[2618]: {"ts": "2026-10-17T17:25:55.260Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1559gitlab # [ 194.732227] nixbot[2618]: {"ts": "2026-10-17T17:25:55.264Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1560gitlab # [ 194.736021] nixbot[2618]: {"ts": "2026-10-17T17:25:55.268Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1561gitlab # [ 194.738217] nixbot[2618]: {"ts": "2026-10-17T17:25:55.270Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1562gitlab # [ 194.739708] nixbot[2618]: {"ts": "2026-10-17T17:25:55.271Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1563gitlab # [ 194.742225] nixbot[2618]: {"ts": "2026-10-17T17:25:55.274Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1564gitlab # [ 194.743679] nixbot[2618]: {"ts": "2026-10-17T17:25:55.275Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1565gitlab # [ 194.745231] nixbot[2618]: {"ts": "2026-10-17T17:25:55.277Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1566gitlab # [ 194.746501] nixbot[2618]: {"ts": "2026-10-17T17:25:55.278Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1567gitlab # [ 194.749684] nixbot[2618]: {"ts": "2026-10-17T17:25:55.281Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1568gitlab # [ 194.751440] nixbot[2618]: {"ts": "2026-10-17T17:25:55.283Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1569gitlab # [ 194.753101] nixbot[2618]: {"ts": "2026-10-17T17:25:55.285Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1570gitlab # [ 194.756226] nixbot[2618]: {"ts": "2026-10-17T17:25:55.288Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1571gitlab # [ 194.758060] nixbot[2618]: {"ts": "2026-10-17T17:25:55.290Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1572gitlab # [ 194.759582] nixbot[2618]: {"ts": "2026-10-17T17:25:55.291Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1573gitlab # [ 194.761292] nixbot[2618]: {"ts": "2026-10-17T17:25:55.293Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1574gitlab # [ 194.763423] nixbot[2618]: {"ts": "2026-10-17T17:25:55.295Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1575gitlab # [ 194.766313] nixbot[2618]: {"ts": "2026-10-17T17:25:55.298Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1576gitlab # [ 194.767831] nixbot[2618]: {"ts": "2026-10-17T17:25:55.299Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1577gitlab # [ 194.769492] nixbot[2618]: {"ts": "2026-10-17T17:25:55.301Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1578gitlab # [ 194.776801] nixbot[2618]: {"ts": "2026-10-17T17:25:55.308Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1579gitlab # [ 194.780348] nixbot[2618]: {"ts": "2026-10-17T17:25:55.312Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1580gitlab # [ 194.783057] nixbot[2618]: {"ts": "2026-10-17T17:25:55.315Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1581gitlab # [ 194.784653] nixbot[2618]: {"ts": "2026-10-17T17:25:55.316Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1582gitlab # [ 194.787825] nixbot[2618]: {"ts": "2026-10-17T17:25:55.319Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1583gitlab # [ 194.790868] nixbot[2618]: {"ts": "2026-10-17T17:25:55.323Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1584gitlab # [ 194.794583] nixbot[2618]: {"ts": "2026-10-17T17:25:55.326Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1585gitlab # [ 194.796852] nixbot[2618]: {"ts": "2026-10-17T17:25:55.329Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1586gitlab # [ 194.799943] nixbot[2618]: {"ts": "2026-10-17T17:25:55.332Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1587gitlab # [ 195.083385] nixbot[2618]: {"ts": "2026-10-17T17:25:55.615Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2618]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"}1588gitlab # [ 195.085800] nixbot[2618]: {"ts": "2026-10-17T17:25:55.615Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"}1589gitlab # [ 195.105668] nixbot[2618]: {"ts": "2026-10-17T17:25:55.637Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58860 - \"GET /health HTTP/1.1\" 200"}1590gitlab # [ 195.113904] systemd[1]: Started nixbot CI service.1591gitlab # [ 195.117356] systemd[1]: Reached target Multi-User System.1592gitlab # [ 195.119343] systemd[1]: Startup finished in 1.175s (kernel) + 3.482s (initrd) + 3min 10.460s (userspace) = 3min 15.119s.1593gitlab # [ 195.314769] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:55 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2071594gitlab # [ 195.330655] nixbot[2618]: {"ts": "2026-10-17T17:25:55.862Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1595gitlab # [ 195.388770] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 491596gitlab # [ 195.392101] nixbot[2618]: {"ts": "2026-10-17T17:25:55.924Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1597gitlab # [ 195.530474] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 1351598gitlab # [ 195.692127] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1521599gitlab: (finished: waiting for unit nixbot.service, in 2.07 seconds)1600gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1601gitlab # [ 195.743289] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 371602gitlab # [ 195.780902] nixbot[2618]: {"ts": "2026-10-17T17:25:56.312Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58874 - \"GET /health HTTP/1.1\" 200"}1603gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1604subtest: project discovered and webhook registered1605gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1606gitlab # [ 195.791363] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 441607gitlab # [ 195.851247] gitaly[913]: time="2026-10-17T17:25:56.382Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC6FBSVYWYG5SVKZGR4JF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-17T17:26:26.071" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:25:56.372" grpc.time_ms=9.201 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 195.851983] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 431609gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1610(finished: subtest: project discovered and webhook registered, in 0.08 seconds)1611subtest: push delivers the webhook1612gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1613gitlab # [ 195.879145] gitaly[913]: time="2026-10-17T17:25:56.411Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC6FBSVYWYG5SVKZGR4JF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:26:26.109" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:25:56.410" grpc.time_ms=0.495 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 195.897130] gitaly[913]: time="2026-10-17T17:25:56.429Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC6FBSVYWYG5SVKZGR4JF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-17T17:26:06.174" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:25:56.424" grpc.time_ms=4.809 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 195.915052] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1151616gitlab # [ 195.962536] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 441617gitlab # [ 195.967571] nixbot[2618]: {"ts": "2026-10-17T17:25:56.499Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1618gitlab # [ 196.053035] gitaly[913]: time="2026-10-17T17:25:56.585Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC6P1JW3QJA9QM4KWE355 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:56.578" grpc.time_ms=6.313 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1619gitlab # [ 196.065639] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 521620gitlab # [ 196.196902] gitaly[913]: time="2026-10-17T17:25:56.729Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC6QRJJVFW4NG7NY6WNCP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:56.723" pid=913 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1621gitlab # [ 196.197167] gitaly[913]: time="2026-10-17T17:25:56.729Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC6QRJJVFW4NG7NY6WNCP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:56.723" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1622gitlab # [ 196.197889] gitaly[913]: time="2026-10-17T17:25:56.729Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC6QRJJVFW4NG7NY6WNCP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:56.723" grpc.time_ms=6.202 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1623gitlab # [ 196.198542] gitlab-workhorse[827]: time="2026-10-17T17:25:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131624gitlab # [ 196.199038] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1291625gitlab # [ 196.290278] gitaly[913]: time="2026-10-17T17:25:56.822Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC6WZD6Y1PJ87P0MTNCAE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:56.803" pid=913 remote_ip="2001:db8:1::1" request_sha=66eed3ab1a6cf3cc856dd52655e5f4d9b6a71546 response_bytes=224 span.kind=server system=grpc1626gitlab # [ 196.290514] gitaly[913]: time="2026-10-17T17:25:56.822Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC6WZD6Y1PJ87P0MTNCAE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:56.803" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1627gitlab # [ 196.291121] gitaly[913]: time="2026-10-17T17:25:56.823Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC6WZD6Y1PJ87P0MTNCAE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:56.803" grpc.time_ms=19.348 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1628gitlab # [ 196.324782] gitlab-workhorse[827]: time="2026-10-17T17:25:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241629gitlab # [ 196.325146] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 881630gitlab # [ 196.404488] gitaly[913]: time="2026-10-17T17:25:56.936Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC710YG6V1ZSVW52NC726 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:56.928" grpc.time_ms=7.851 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1631gitlab # [ 196.428701] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 641632gitlab # [ 196.520069] gitaly[913]: time="2026-10-17T17:25:57.052Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7338QBG3BBZ8CA2D6RW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:57.041" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1633gitlab # [ 196.520979] gitaly[913]: time="2026-10-17T17:25:57.052Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7338QBG3BBZ8CA2D6RW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:57.041" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1634gitlab # [ 196.522465] gitaly[913]: time="2026-10-17T17:25:57.052Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7338QBG3BBZ8CA2D6RW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:57.041" grpc.time_ms=11.217 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1635gitlab # [ 196.582324] gitlab-workhorse[827]: time="2026-10-17T17:25:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671636gitlab # [ 196.583511] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1511637gitlab # [ 196.678022] gitaly[913]: time="2026-10-17T17:25:57.210Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC790MB663CSSTHHWYGY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:57.199" grpc.time_ms=10.837 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1638gitlab # [ 196.678478] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 581639gitlab # [ 196.731235] gitaly[913]: time="2026-10-17T17:25:57.263Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7AWWQT67TVF8PQSCBDF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:57.247" pid=913 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1640gitlab # [ 196.731870] gitaly[913]: time="2026-10-17T17:25:57.263Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7AWWQT67TVF8PQSCBDF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:57.247" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1641gitlab # [ 196.733347] gitaly[913]: time="2026-10-17T17:25:57.264Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7AWWQT67TVF8PQSCBDF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:25:57.247" grpc.time_ms=16.963 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1642gitlab # [ 196.778745] gitlab-workhorse[827]: time="2026-10-17T17:25:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091643gitlab # [ 196.779083] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 981644gitlab # [ 196.876806] gitaly[913]: time="2026-10-17T17:25:57.408Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:26:27.007" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:25:57.407" grpc.time_ms=0.498 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1645gitlab # [ 196.945047] gitaly[913]: time="2026-10-17T17:25:57.477Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-17T17:26:27.070" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:25:57.471" grpc.time_ms=5.982 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1646gitlab # [ 196.960253] gitaly[913]: time="2026-10-17T17:25:57.492Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:07.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:25:57.487" grpc.time_ms=4.797 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 196.995578] gitaly[913]: time="2026-10-17T17:25:57.527Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:07.042" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:25:57.522" grpc.time_ms=5.141 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1648gitlab # [ 197.044231] gitaly[913]: time="2026-10-17T17:25:57.576Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-17T17:26:07.095" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:57.576" grpc.time_ms=0.175 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1649gitlab # [ 197.072657] gitaly[913]: time="2026-10-17T17:25:57.604Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-17T17:26:07.119" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:25:57.599" grpc.time_ms=5.299 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1650gitlab # [ 197.101605] gitaly[913]: time="2026-10-17T17:25:57.633Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:25:57.633" grpc.time_ms=0.315 pid=913 span.kind=server system=grpc1651gitlab # [ 197.126281] gitaly[913]: time="2026-10-17T17:25:57.658Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:25:57.658" grpc.time_ms=0.317 pid=913 span.kind=server system=grpc1652gitlab # [ 197.142707] gitaly[913]: time="2026-10-17T17:25:57.675Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ diskcache=f086a80b-354a-4fab-a1e7-b2badd171ed5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:07.126" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:57.606" pid=913 ref=refs/keep-around/e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c remote_ip="2001:db8:1::1" revision=e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c span.kind=server system=grpc username=root1653gitlab # [ 197.142915] gitaly[913]: time="2026-10-17T17:25:57.675Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=52 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5519 command.oublock=8 command.real_time_ms=62 command.spawn_token_fork_ms=0 command.system_time_ms=21 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:07.126" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:25:57.606" grpc.time_ms=68.792 pid=913 ref=refs/keep-around/e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c remote_ip="2001:db8:1::1" revision=e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c span.kind=server system=grpc username=root1654gitlab # [ 197.166751] gitaly[913]: time="2026-10-17T17:25:57.699Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:26:27.298" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:25:57.698" grpc.time_ms=0.277 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 197.384826] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:25:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5691656gitlab # [ 197.397879] nixbot[2618]: {"ts": "2026-10-17T17:25:57.929Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e2f11a4f44c6-0"}1657gitlab # [ 197.530069] nixbot[2618]: {"ts": "2026-10-17T17:25:58.062Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e2f11a4f44c6-0", "argv0": "bwrap"}1658gitlab # [ 197.605421] systemd[1]: Started Nix Daemon.1659gitlab # [ 197.668330] nix-daemon[2777]: accepted connection from pid 2772, user nixbot1660gitlab # [ 202.391941] nix-daemon[2777]: accepted connection from pid 2826, user nixbot1661gitlab # [ 202.399237] nix-daemon[2777]: accepted connection from pid 2772, user nixbot1662gitlab # [ 206.482672] nix-daemon[2777]: accepted connection from pid 2772, user nixbot1663gitlab # [ 206.541145] nix-daemon[2777]: accepted connection from pid 2868, user nixbot1664gitlab # [ 206.597703] gitaly[913]: time="2026-10-17T17:26:07.129Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55ECGZ4R1ASQTWVH9NQCZNB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:26:37.028" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:07.128" grpc.time_ms=0.59 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 206.633167] gitaly[913]: time="2026-10-17T17:26:07.165Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55ECGZ4R1ASQTWVH9NQCZNB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:17.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:07.160" grpc.time_ms=5.131 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1666gitlab # [ 206.681161] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1361667gitlab # [ 206.724901] gitaly[913]: time="2026-10-17T17:26:07.257Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55ECH3G2A2ENXNY9CFMD4YJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:26:37.056" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:07.256" grpc.time_ms=0.481 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1668gitlab # [ 206.799691] gitaly[913]: time="2026-10-17T17:26:07.331Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55ECH3G2A2ENXNY9CFMD4YJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:17.076" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:07.326" grpc.time_ms=5.264 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669gitlab # [ 206.866556] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1821670gitlab # [ 211.426067] nix-daemon[2777]: accepted connection from pid 2943, user nixbot1671gitlab # [ 211.491147] gitaly[913]: time="2026-10-17T17:26:12.022Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55ECNRH94Y9W6P14PEBFY0K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:26:42.021" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:12.021" grpc.time_ms=0.784 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 211.538126] gitaly[913]: time="2026-10-17T17:26:12.070Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55ECNRH94Y9W6P14PEBFY0K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:22.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:12.064" grpc.time_ms=5.656 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab # [ 211.595736] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1411674gitlab # [ 211.780182] nixbot[2618]: {"ts": "2026-10-17T17:26:12.311Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}1675gitlab # [ 211.894337] gitaly[913]: time="2026-10-17T17:26:12.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55ECP48WAEFG56CG4EEDN8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:12.415" grpc.time_ms=10.577 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1676gitlab # [ 211.922779] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651677gitlab # [ 211.996499] gitaly[913]: time="2026-10-17T17:26:12.528Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55ECP7C1Q9HJ4QHP0ZAD4E0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:12.517" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1678gitlab # [ 211.997301] gitaly[913]: time="2026-10-17T17:26:12.528Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55ECP7C1Q9HJ4QHP0ZAD4E0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:12.517" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1679gitlab # [ 211.998344] gitaly[913]: time="2026-10-17T17:26:12.529Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55ECP7C1Q9HJ4QHP0ZAD4E0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:12.517" grpc.time_ms=12.653 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1680gitlab # [ 211.999685] gitlab-workhorse[827]: time="2026-10-17T17:26:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671681gitlab # [ 212.001130] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 701682gitlab # [ 212.124893] gitaly[913]: time="2026-10-17T17:26:12.656Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55ECPBV331P6F56HKJ1T6KS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:12.648" grpc.time_ms=7.521 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1683gitlab # [ 212.125183] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 531684gitlab # [ 212.182978] gitaly[913]: time="2026-10-17T17:26:12.715Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55ECPE4TPW41NZ1RASA6V5T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:12.709" pid=913 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1685gitlab # [ 212.183220] gitaly[913]: time="2026-10-17T17:26:12.715Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55ECPE4TPW41NZ1RASA6V5T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:12.709" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1686gitlab # [ 212.183791] gitaly[913]: time="2026-10-17T17:26:12.715Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55ECPE4TPW41NZ1RASA6V5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:12.709" grpc.time_ms=5.904 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1687gitlab # [ 212.226890] gitlab-workhorse[827]: time="2026-10-17T17:26:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671688gitlab # [ 212.227737] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 831689gitlab # [ 212.292152] sidekiq-cluster[2495]: 2026-10-17T17:26:12.824Z pid=2495 tid=xsn INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2495, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>448872448}1690gitlab # [ 212.456806] sidekiq-cluster[2495]: W, [2026-10-17T17:26:12.988800 #2495] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1691gitlab # [ 212.493613] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:13.025Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1692gitlab # [ 214.222883] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:14.754Z","message":"GitLab reliable fetch activated!"}1693gitlab # [ 214.223106] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:14.755Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1694gitlab # [ 232.409640] postgres[3164]: [3164] ERROR: relation "table_without_models" does not exist1695gitlab # [ 232.410204] postgres[3164]: [3164] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1696gitlab # [ 234.692563] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:35.224Z","message":"Booted Rails 7.2.3.1 application in production environment"}1697gitlab # [ 234.693518] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:35.225Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1698gitlab # [ 234.696234] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:35.225Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1699gitlab # [ 234.697317] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:35.225Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1700gitlab # [ 234.698533] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:35.226Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1701gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 39.13 seconds)1702gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1703gitlab # [ 235.085305] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:35 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 381704gitlab # [ 235.188711] gitaly[913]: time="2026-10-17T17:26:35.720Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M55EDCV6S84H9AZA83XFFKP8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:35.709" grpc.time_ms=11.037 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1705gitlab # [ 235.190294] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:35 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 971706gitlab # Enumerating objects: 5, done.1707gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1708gitlab # Delta compression using up to 4 threads1709gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1710gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1711gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1712gitlab # [ 235.489632] gitaly[913]: time="2026-10-17T17:26:36.021Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-17T17:27:06.014" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-17T17:26:36.015" grpc.time_ms=6.214 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab # [ 235.528828] gitaly[913]: time="2026-10-17T17:26:36.061Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M55EDD059ECW2HH77G3V8MF4 duration_ms=103ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/allowed"1714gitlab # [ 235.562101] gitaly[913]: time="2026-10-17T17:26:36.094Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M55EDD059ECW2HH77G3V8MF4 duration_ms=30ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/pre_receive"1715gitlab # [ 235.569895] gitaly[913]: time="2026-10-17T17:26:36.095Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:35.955" grpc.time_ms=138.951 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1716gitlab # [ 235.617373] gitaly[913]: time="2026-10-17T17:26:36.149Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:36.148" grpc.time_ms=0.595 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1717gitlab # [ 235.651642] gitaly[913]: time="2026-10-17T17:26:36.183Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:36.183" grpc.time_ms=0.344 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1718gitlab # [ 235.688648] gitaly[913]: time="2026-10-17T17:26:36.220Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:36.220" grpc.time_ms=0.25 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # [ 235.745933] gitaly[913]: time="2026-10-17T17:26:36.278Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M55EDD059ECW2HH77G3V8MF4 duration_ms=30ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/post_receive"1720gitlab # [ 235.751769] gitaly[913]: time="2026-10-17T17:26:36.278Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:36.246" grpc.time_ms=31.56 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1721gitlab # [ 235.778951] gitaly[913]: time="2026-10-17T17:26:36.311Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 diskcache=9097ddcb-66bd-4979-a87a-f156af5fd9bf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:35.879" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1722gitlab # [ 235.787987] gitaly[913]: time="2026-10-17T17:26:36.311Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=195 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=880640 command.minflt=13145 command.oublock=32 command.real_time_ms=421 command.spawn_token_fork_ms=0 command.system_time_ms=136 command.user_time_ms=59 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:35.879" grpc.time_ms=431.682 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1723gitlab # [ 235.788505] gitlab-workhorse[827]: time="2026-10-17T17:26:36Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521724gitlab # [ 235.788900] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:36 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5301725gitlab # To http://gitlab/root/test-flake.git1726gitlab # e2f11a4..0bf7271 master -> master1727gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.81 seconds)1728gitlab: must succeed: git -C /tmp/test-flake rev-parse master1729gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1730gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045'1731gitlab # [ 235.884725] nixbot[2618]: {"ts": "2026-10-17T17:26:36.416Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:50184 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1\" 200"}1732gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045', in 0.07 seconds)1733gitlab # [ 235.978817] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:36.509Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2a4d855849dfe9bdd7e5d5fb","created_at":"2026-10-17T17:25:46.654Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:46.675Z","job_size_bytes":2,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2a4d855849dfe9bdd7e5d5fb: start","job_status":"start","queue_duration_s":49.834668,"scheduling_latency_s":49.834733}1734gitlab # [ 236.203917] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:36.735Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2a4d855849dfe9bdd7e5d5fb","created_at":"2026-10-17T17:25:46.654Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:46.675Z","job_size_bytes":2,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2a4d855849dfe9bdd7e5d5fb: done: 0.225949 sec","job_status":"done","queue_duration_s":49.834668,"scheduling_latency_s":49.834733,"redis_calls":25,"redis_duration_s":0.008312,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.005074,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001887,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.099970527,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.225949,"completed_at":"2026-10-17T17:26:36.735Z","load_balancing_strategy":"primary","db_duration_s":0.059812,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1735gitlab # [ 236.269064] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:36.800Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6bc4f58c9d1a18c0eb8bca8f","created_at":"2026-10-17T17:25:46.682Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:46.688Z","job_size_bytes":2,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6bc4f58c9d1a18c0eb8bca8f: start","job_status":"start","queue_duration_s":50.112165,"scheduling_latency_s":50.112209}1736gitlab # [ 236.383500] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:36.915Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6bc4f58c9d1a18c0eb8bca8f","created_at":"2026-10-17T17:25:46.682Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:46.688Z","job_size_bytes":2,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6bc4f58c9d1a18c0eb8bca8f: done: 0.114734 sec","job_status":"done","queue_duration_s":50.112165,"scheduling_latency_s":50.112209,"redis_calls":14,"redis_duration_s":0.002644,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000711,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000804,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.078233128,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.114734,"completed_at":"2026-10-17T17:26:36.915Z","load_balancing_strategy":"primary","db_duration_s":0.021553,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1737gitlab # [ 236.423033] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:36.955Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"cd8ad7b00336d8b1c99225a5","created_at":"2026-10-17T17:25:47.159Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:47.164Z","job_size_bytes":5,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-cd8ad7b00336d8b1c99225a5: start","job_status":"start","queue_duration_s":49.790839,"scheduling_latency_s":49.79087}1738gitlab # [ 236.568885] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:37.100Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"cd8ad7b00336d8b1c99225a5","created_at":"2026-10-17T17:25:47.159Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:47.164Z","job_size_bytes":5,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-cd8ad7b00336d8b1c99225a5: done: 0.145946 sec","job_status":"done","queue_duration_s":49.790839,"scheduling_latency_s":49.79087,"redis_calls":12,"redis_duration_s":0.002308,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.0007,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209803,"duration_s":0.145946,"completed_at":"2026-10-17T17:26:37.100Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02255,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1739gitlab # [ 236.608699] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:37.140Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d637fb060a04facf1bf10dbb","created_at":"2026-10-17T17:25:47.184Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:47.187Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d637fb060a04facf1bf10dbb: start","job_status":"start","queue_duration_s":49.952906,"scheduling_latency_s":49.952929}1740gitlab # [ 236.741306] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:37.273Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d637fb060a04facf1bf10dbb","created_at":"2026-10-17T17:25:47.184Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:47.187Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d637fb060a04facf1bf10dbb: done: 0.132581 sec","job_status":"done","queue_duration_s":49.952906,"scheduling_latency_s":49.952929,"redis_calls":11,"redis_duration_s":0.00214,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000666,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.092,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.092,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207009,"duration_s":0.132581,"completed_at":"2026-10-17T17:26:37.273Z","load_balancing_strategy":"primary","db_duration_s":0.034955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1741gitlab # [ 236.779827] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:37.311Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"e70d7109033b8a7d95207971","created_at":"2026-10-17T17:25:47.190Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:47.192Z","job_size_bytes":89,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-e70d7109033b8a7d95207971: start","job_status":"start","queue_duration_s":50.118965,"scheduling_latency_s":50.118987}1742gitlab # [ 236.820933] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:37.352Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"e70d7109033b8a7d95207971","created_at":"2026-10-17T17:25:47.190Z","trace_propagation_headers":{"sentry-trace":"8ce0bdcfba0440c496074524ad748f2d-f11d51fa6b864be5","baggage":"sentry-trace_id=8ce0bdcfba0440c496074524ad748f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EBW8SHAKTAGBAQ3F34HVN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:47.192Z","job_size_bytes":89,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-e70d7109033b8a7d95207971: done: 0.040875 sec","job_status":"done","queue_duration_s":50.118965,"scheduling_latency_s":50.118987,"redis_calls":11,"redis_duration_s":0.001521,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000436,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223493,"duration_s":0.040875,"completed_at":"2026-10-17T17:26:37.352Z","load_balancing_strategy":"primary","db_duration_s":0.005777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1743gitlab # [ 236.860494] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:37.392Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a346f0a2aa00accb96fb0970","created_at":"2026-10-17T17:25:54.008Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-186f1b53933e44c8","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:54.011Z","job_size_bytes":185,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a346f0a2aa00accb96fb0970: start","job_status":"start","queue_duration_s":43.381019,"scheduling_latency_s":43.381042}1744gitlab # [ 236.873080] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:37.405Z","message":"changes: \"0000000000000000000000000000000000000000 e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c refs/heads/master\\n\""}1745gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045'1746gitlab # [ 236.902875] gitaly[913]: time="2026-10-17T17:26:37.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:47.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:37.428" grpc.time_ms=6.294 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 236.913644] nixbot[2618]: {"ts": "2026-10-17T17:26:37.445Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:50196 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1\" 200"}1748gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045', in 0.02 seconds)1749gitlab # [ 236.927332] gitaly[913]: time="2026-10-17T17:26:37.459Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T17:26:47.032" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:37.452" grpc.time_ms=6.697 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1750gitlab # [ 236.995760] gitaly[913]: time="2026-10-17T17:26:37.528Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-17T17:26:47.098" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:37.518" grpc.time_ms=9.603 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751gitlab # [ 237.031903] gitaly[913]: time="2026-10-17T17:26:37.564Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:37.563" grpc.time_ms=0.268 pid=913 span.kind=server system=grpc1752gitlab # [ 237.064319] gitaly[913]: time="2026-10-17T17:26:37.596Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3934 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:37.596" grpc.time_ms=0.253 pid=913 span.kind=server system=grpc1753gitlab # [ 237.083188] gitaly[913]: time="2026-10-17T17:26:37.615Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX diskcache=9577e0d7-0b56-4692-a481-5291f2480a6b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:47.116" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:37.537" pid=913 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1754gitlab # [ 237.083820] gitaly[913]: time="2026-10-17T17:26:37.615Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=67 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5101 command.oublock=8 command.real_time_ms=69 command.spawn_token_fork_ms=1 command.system_time_ms=40 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:47.116" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:37.537" grpc.time_ms=78.383 pid=913 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1755gitlab # [ 237.095119] gitaly[913]: time="2026-10-17T17:26:37.627Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T17:26:47.206" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:37.626" grpc.time_ms=0.181 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1756gitlab # [ 237.123321] gitaly[913]: time="2026-10-17T17:26:37.655Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=938 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-17T17:26:47.227" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:37.648" grpc.time_ms=7.32 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757gitlab # [ 237.178340] gitaly[913]: time="2026-10-17T17:26:37.709Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-17T17:27:07.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:37.705" grpc.time_ms=3.942 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 237.206681] gitaly[913]: time="2026-10-17T17:26:37.738Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-17T17:26:47.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:37.738" grpc.time_ms=0.157 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 237.220500] gitaly[913]: time="2026-10-17T17:26:37.752Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-17T17:26:47.019" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-17T17:26:37.749" grpc.time_ms=3.109 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 237.237477] gitaly[913]: time="2026-10-17T17:26:37.769Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:47.029" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:37.759" grpc.time_ms=9.738 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 237.249728] gitaly[913]: time="2026-10-17T17:26:37.782Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:47.046" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:37.776" grpc.time_ms=5.434 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 237.270273] gitaly[913]: time="2026-10-17T17:26:37.802Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=959 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-17T17:27:07.094" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:37.794" grpc.time_ms=7.932 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 237.604314] gitaly[913]: time="2026-10-17T17:26:38.136Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-17T17:26:48.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:38.135" grpc.time_ms=1.084 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 237.635904] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.167Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a346f0a2aa00accb96fb0970","created_at":"2026-10-17T17:25:54.008Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-186f1b53933e44c8","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:25:54.011Z","job_size_bytes":185,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a346f0a2aa00accb96fb0970: done: 0.774772 sec","job_status":"done","queue_duration_s":43.381019,"scheduling_latency_s":43.381042,"gitaly_calls":13,"gitaly_duration_s":0.235307,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.044014,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.002847,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.004894,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001429,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00284,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.024117,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.007887,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.168,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.182,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.442391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048414,"exclusive_lock_hold_duration_s":0.03730558,"duration_s":0.774772,"completed_at":"2026-10-17T17:26:38.167Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.078469,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1765gitlab # [ 237.642469] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.168Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"52c1ebe40cb1cf27306770b4","created_at":"2026-10-17T17:25:57.715Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-8994e0b87af34164","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:57.721Z","job_size_bytes":65,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-52c1ebe40cb1cf27306770b4: start","job_status":"start","queue_duration_s":40.447017,"scheduling_latency_s":40.447031}1766gitlab # [ 237.756991] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.288Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"52c1ebe40cb1cf27306770b4","created_at":"2026-10-17T17:25:57.715Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-8994e0b87af34164","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:57.721Z","job_size_bytes":65,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-52c1ebe40cb1cf27306770b4: done: 0.120668 sec","job_status":"done","queue_duration_s":40.447017,"scheduling_latency_s":40.447031,"redis_calls":16,"redis_duration_s":0.002134,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001123,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206172,"duration_s":0.120668,"completed_at":"2026-10-17T17:26:38.288Z","load_balancing_strategy":"primary","db_duration_s":0.020505,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1767gitlab # [ 237.759381] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.291Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fd4765fec23479e0a6e38ec1","created_at":"2026-10-17T17:25:57.722Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-8994e0b87af34164","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:57.725Z","job_size_bytes":65,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fd4765fec23479e0a6e38ec1: start","job_status":"start","queue_duration_s":40.565862,"scheduling_latency_s":40.565909}1768gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045'1769gitlab # [ 237.923207] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.454Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fd4765fec23479e0a6e38ec1","created_at":"2026-10-17T17:25:57.722Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-8994e0b87af34164","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:57.725Z","job_size_bytes":65,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fd4765fec23479e0a6e38ec1: done: 0.163835 sec","job_status":"done","queue_duration_s":40.565862,"scheduling_latency_s":40.565909,"redis_calls":21,"redis_duration_s":0.0045249999999999995,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001854,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001268,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000292216,"duration_s":0.163835,"completed_at":"2026-10-17T17:26:38.454Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1770gitlab # [ 237.925277] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.456Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0c1fac3d98e021c8ac2bc70b","created_at":"2026-10-17T17:25:57.898Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-8994e0b87af34164","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:57.902Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0c1fac3d98e021c8ac2bc70b: start","job_status":"start","queue_duration_s":40.553295,"scheduling_latency_s":40.55331}1771gitlab # [ 237.998281] nixbot[2618]: {"ts": "2026-10-17T17:26:38.530Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:50206 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1\" 200"}1772gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045', in 0.09 seconds)1773gitlab # [ 238.068820] gitaly[913]: time="2026-10-17T17:26:38.600Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:38.599" grpc.time_ms=0.472 pid=913 span.kind=server system=grpc1774gitlab # [ 238.107473] gitaly[913]: time="2026-10-17T17:26:38.639Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:38.639" grpc.time_ms=0.314 pid=913 span.kind=server system=grpc1775gitlab # [ 238.144185] gitaly[913]: time="2026-10-17T17:26:38.676Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:38.675" grpc.time_ms=0.384 pid=913 span.kind=server system=grpc1776gitlab # [ 238.160329] gitaly[913]: time="2026-10-17T17:26:38.692Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ diskcache=50409653-ca22-4d63-b59f-3ad773a30943 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:08.070" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:38.571" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 238.169367] gitaly[913]: time="2026-10-17T17:26:38.701Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=116 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7529 command.oublock=0 command.real_time_ms=115 command.spawn_token_fork_ms=0 command.system_time_ms=74 command.user_time_ms=42 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:08.070" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:38.571" grpc.time_ms=121.571 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778gitlab # [ 238.275568] gitaly[913]: time="2026-10-17T17:26:38.807Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-17T17:27:08.106" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:38.806" grpc.time_ms=1.144 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1779gitlab # [ 238.334254] gitaly[913]: time="2026-10-17T17:26:38.866Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC7F10P6MNZPMTMDJEHCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:08.164" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:38.865" grpc.time_ms=0.786 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1780gitlab # [ 238.348662] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.880Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0c1fac3d98e021c8ac2bc70b","created_at":"2026-10-17T17:25:57.898Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-8994e0b87af34164","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:57.902Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2495,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0c1fac3d98e021c8ac2bc70b: rescheduled"}1781gitlab # [ 238.361444] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.893Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0c1fac3d98e021c8ac2bc70b","created_at":"2026-10-17T17:25:57.898Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-8994e0b87af34164","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:25:57.902Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0c1fac3d98e021c8ac2bc70b: done: 0.436919 sec","job_status":"done","queue_duration_s":40.553295,"scheduling_latency_s":40.55331,"gitaly_calls":3,"gitaly_duration_s":0.1309,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.035996,"redis_read_bytes":460,"redis_write_bytes":29296,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001153,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001127,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.020358,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003572,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15583,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005615,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000522,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000508,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001988,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.021,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.027,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192572,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.384972112,"duration_s":0.436919,"completed_at":"2026-10-17T17:26:38.893Z","load_balancing_strategy":"primary","db_duration_s":0.087119,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1782gitlab # [ 238.409987] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.895Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c 0bf727147db4ad4b5f61597b2acf332f6a704045 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2bdaab75ae28cae5466963d5","created_at":"2026-10-17T17:26:36.266Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-da61ac99dab247b9","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:26:36.268Z","job_size_bytes":185,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2bdaab75ae28cae5466963d5: start","job_status":"start","queue_duration_s":2.627077,"scheduling_latency_s":2.627103}1783gitlab # [ 238.411165] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.906Z","message":"changes: \"e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c 0bf727147db4ad4b5f61597b2acf332f6a704045 refs/heads/master\\n\""}1784gitlab # [ 238.411875] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:38.940Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8ad3279e911d2e570538216e","created_at":"2026-10-17T17:26:38.938Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-564ceffe391d4d8b","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"49e59ba35ab526285f93f27b","job_size_bytes":46,"pid":2495,"job_status":"deduplicated","message":"ProjectCacheWorker JID-8ad3279e911d2e570538216e: deduplicated: until executing","deduplication.type":"until executing"}1785gitlab # [ 238.451761] gitaly[913]: time="2026-10-17T17:26:38.926Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:48.189" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:38.919" grpc.time_ms=7.33 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 238.452838] gitaly[913]: time="2026-10-17T17:26:38.936Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T17:26:48.199" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:38.929" grpc.time_ms=6.612 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 238.453802] gitaly[913]: time="2026-10-17T17:26:38.954Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-17T17:26:48.218" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:38.948" grpc.time_ms=5.569 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 238.456676] gitaly[913]: time="2026-10-17T17:26:38.962Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-17T17:27:08.256" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:38.956" grpc.time_ms=5.531 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 238.471259] gitaly[913]: time="2026-10-17T17:26:38.971Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-17T17:26:48.237" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-17T17:26:38.967" grpc.time_ms=3.434 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 238.516202] gitaly[913]: time="2026-10-17T17:26:38.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:48.245" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:38.975" grpc.time_ms=7.094 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 238.545276] gitaly[913]: time="2026-10-17T17:26:39.077Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-17T17:26:49.002" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.042" grpc.time_ms=35.09 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 238.558418] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.090Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c 0bf727147db4ad4b5f61597b2acf332f6a704045 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2bdaab75ae28cae5466963d5","created_at":"2026-10-17T17:26:36.266Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-da61ac99dab247b9","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-17T17:26:36.268Z","job_size_bytes":185,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2bdaab75ae28cae5466963d5: done: 0.19518 sec","job_status":"done","queue_duration_s":2.627077,"scheduling_latency_s":2.627103,"gitaly_calls":7,"gitaly_duration_s":0.081472,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.014659,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.001304,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000653,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002661,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.005068,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.004973,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000455645,"exclusive_lock_hold_duration_s":0.013894503,"duration_s":0.19518,"completed_at":"2026-10-17T17:26:39.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015756,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1793gitlab # [ 238.604024] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.136Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"49e59ba35ab526285f93f27b","created_at":"2026-10-17T17:26:37.472Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:37.494Z","job_size_bytes":46,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-49e59ba35ab526285f93f27b: start","job_status":"start","queue_duration_s":1.641303,"scheduling_latency_s":1.641329}1794gitlab # [ 238.649181] gitaly[913]: time="2026-10-17T17:26:39.181Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-17T23:26:39.178" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:39.179" grpc.time_ms=2.092 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 238.665741] gitaly[913]: time="2026-10-17T17:26:39.198Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-17T17:27:09.090" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.191" grpc.time_ms=6.551 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 238.698953] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.230Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"49e59ba35ab526285f93f27b","created_at":"2026-10-17T17:26:37.472Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:37.494Z","job_size_bytes":46,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-49e59ba35ab526285f93f27b: done: 0.094226 sec","job_status":"done","queue_duration_s":1.641303,"scheduling_latency_s":1.641329,"gitaly_calls":2,"gitaly_duration_s":0.028225,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004201,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.00036,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001576,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194438,"duration_s":0.094226,"completed_at":"2026-10-17T17:26:39.230Z","load_balancing_strategy":"primary","db_duration_s":0.011403,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1797gitlab # [ 238.702813] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.231Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"3787489eb54b10f99943e05a","created_at":"2026-10-17T17:26:37.507Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:37.512Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-3787489eb54b10f99943e05a: start","job_status":"start","queue_duration_s":1.719153,"scheduling_latency_s":1.719168}1798gitlab # [ 238.792076] gitaly[913]: time="2026-10-17T17:26:39.324Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX diskcache=bfa44f0f-ac2a-469f-9310-8fb741903c8f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-17T23:26:39.305" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.305" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 238.792853] gitaly[913]: time="2026-10-17T17:26:39.324Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1284 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-17T23:26:39.305" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.305" grpc.time_ms=18.509 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 238.821517] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.353Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"3787489eb54b10f99943e05a","created_at":"2026-10-17T17:26:37.507Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:37.512Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-3787489eb54b10f99943e05a: done: 0.122096 sec","job_status":"done","queue_duration_s":1.719153,"scheduling_latency_s":1.719168,"gitaly_calls":1,"gitaly_duration_s":0.020646,"redis_calls":15,"redis_duration_s":0.002218,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000354,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.048344412,"duration_s":0.122096,"completed_at":"2026-10-17T17:26:39.353Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1801gitlab # [ 238.823913] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.354Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"77707dece86f76fc1a5e22af","created_at":"2026-10-17T17:26:37.623Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:37.624Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-77707dece86f76fc1a5e22af: start","job_status":"start","queue_duration_s":1.729559,"scheduling_latency_s":1.729605}1802gitlab # [ 238.866319] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.395Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"77707dece86f76fc1a5e22af","created_at":"2026-10-17T17:26:37.623Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:37.624Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-77707dece86f76fc1a5e22af: done: 0.041342 sec","job_status":"done","queue_duration_s":1.729559,"scheduling_latency_s":1.729605,"gitaly_calls":1,"gitaly_duration_s":0.012661,"redis_calls":16,"redis_duration_s":0.003201,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000279,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.00165,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041342,"completed_at":"2026-10-17T17:26:39.395Z","load_balancing_strategy":"primary","db_duration_s":0.002143,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1803gitlab # [ 238.906683] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.397Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6ce682b41da6977332b9a157","created_at":"2026-10-17T17:26:38.021Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:456563b4ad4d7eab4e0a947c049d3a264737a0a8ff17a11935ee52b9abc4c040","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.025Z","job_size_bytes":467,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6ce682b41da6977332b9a157: start","job_status":"start","queue_duration_s":1.372719,"scheduling_latency_s":1.372754}1804gitlab # [ 238.907579] gitaly[913]: time="2026-10-17T17:26:39.383Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-17T17:27:09.272" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.372" grpc.time_ms=10.505 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 238.908179] gitaly[913]: time="2026-10-17T17:26:39.427Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:09.326" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.427" grpc.time_ms=0.584 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 238.947911] gitaly[913]: time="2026-10-17T17:26:39.437Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-17T17:26:49.299" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:39.429" grpc.time_ms=7.892 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 238.984566] gitaly[913]: time="2026-10-17T17:26:39.516Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-17T17:27:09.416" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.516" grpc.time_ms=0.518 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045'1809gitlab # [ 238.996173] gitaly[913]: time="2026-10-17T17:26:39.520Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=42 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-17T17:27:09.418" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.518" grpc.time_ms=1.486 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 239.023618] nixbot[2618]: {"ts": "2026-10-17T17:26:39.555Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:50210 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1\" 200"}1811gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045', in 0.02 seconds)1812gitlab # [ 239.052262] gitaly[913]: time="2026-10-17T17:26:39.584Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:49.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:39.579" grpc.time_ms=4.993 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 239.395726] gitaly[913]: time="2026-10-17T17:26:39.927Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=957 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-17T17:27:09.819" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.919" grpc.time_ms=7.983 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 239.404528] gitaly[913]: time="2026-10-17T17:26:39.936Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EC3SQN9TP4KV8RJSK2NKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-17T17:27:09.830" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:39.930" grpc.time_ms=6.487 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 239.421896] sidekiq-cluster[2495]: {"severity":"WARN","time":"2026-10-17T17:26:39.954Z","class":"CreatePipelineWorker","correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c","ref":"refs/heads/master"},"retry":0}1816gitlab # [ 239.426470] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.958Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6ce682b41da6977332b9a157","created_at":"2026-10-17T17:26:38.021Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:456563b4ad4d7eab4e0a947c049d3a264737a0a8ff17a11935ee52b9abc4c040","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.025Z","job_size_bytes":467,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6ce682b41da6977332b9a157: done: 0.560668 sec","job_status":"done","queue_duration_s":1.372719,"scheduling_latency_s":1.372754,"gitaly_calls":7,"gitaly_duration_s":0.048905,"redis_calls":51,"redis_duration_s":0.0061259999999999995,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000546,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.00241,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001664,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.478041,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214273,"duration_s":0.560668,"completed_at":"2026-10-17T17:26:39.958Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031294,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1817gitlab # [ 239.484851] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:39.959Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"1a91022a-0e5b-424c-aae3-26796d4169ca\"}"],"class":"WebHookWorker","jid":"84f693972fd1b799444206be","created_at":"2026-10-17T17:26:38.112Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:76bbd8192b0e0efb2c9e2029dacd219fbf044fc926f97c2b558cbf01f88834c0","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.116Z","job_size_bytes":1751,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-84f693972fd1b799444206be: start","job_status":"start","queue_duration_s":1.842614,"scheduling_latency_s":1.842677}1818gitlab # [ 239.510342] nixbot[2618]: {"ts": "2026-10-17T17:26:40.042Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "2af020fe-5aa5-48f5-9919-b38f2bf4261d", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c", "pr": null}1819gitlab # [ 239.513828] nixbot[2618]: {"ts": "2026-10-17T17:26:40.046Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:50226 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1820gitlab # [ 239.525742] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.057Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"1a91022a-0e5b-424c-aae3-26796d4169ca\"}"],"class":"WebHookWorker","jid":"84f693972fd1b799444206be","created_at":"2026-10-17T17:26:38.112Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-c7e2931425b7430a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:76bbd8192b0e0efb2c9e2029dacd219fbf044fc926f97c2b558cbf01f88834c0","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.116Z","job_size_bytes":1751,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-84f693972fd1b799444206be: done: 0.09816 sec","job_status":"done","queue_duration_s":1.842614,"scheduling_latency_s":1.842677,"redis_calls":19,"redis_duration_s":0.002131,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000211,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03544863900000905,"cpu_s":0.05436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194996,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.09816,"completed_at":"2026-10-17T17:26:40.057Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1821gitlab # [ 239.565856] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.059Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"283db9dff9ae0e995d89777b","created_at":"2026-10-17T17:26:38.560Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.563Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-283db9dff9ae0e995d89777b: start","job_status":"start","queue_duration_s":1.495411,"scheduling_latency_s":1.495426}1822gitlab # [ 239.566917] gitaly[913]: time="2026-10-17T17:26:40.099Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDH5X3V6ZWD4G6J0N478H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:40.092" grpc.time_ms=6.936 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1823gitlab # [ 239.567922] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 381824gitlab # [ 239.579406] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.111Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"283db9dff9ae0e995d89777b","created_at":"2026-10-17T17:26:38.560Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.563Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-283db9dff9ae0e995d89777b: done: 0.052405 sec","job_status":"done","queue_duration_s":1.495411,"scheduling_latency_s":1.495426,"redis_calls":10,"redis_duration_s":0.0014939999999999999,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000221257,"duration_s":0.052405,"completed_at":"2026-10-17T17:26:40.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009301,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1825gitlab # [ 239.628352] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.113Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"82954b0bb60e01e60bd3ecf3","created_at":"2026-10-17T17:26:38.699Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.716Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-82954b0bb60e01e60bd3ecf3: start","job_status":"start","queue_duration_s":1.396563,"scheduling_latency_s":1.396577}1826gitlab # [ 239.629221] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.133Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"82954b0bb60e01e60bd3ecf3","created_at":"2026-10-17T17:26:38.699Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.716Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-82954b0bb60e01e60bd3ecf3: done: 0.019962 sec","job_status":"done","queue_duration_s":1.396563,"scheduling_latency_s":1.396577,"redis_calls":10,"redis_duration_s":0.001348,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200025,"duration_s":0.019962,"completed_at":"2026-10-17T17:26:40.133Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1827gitlab # [ 239.691243] gitaly[913]: time="2026-10-17T17:26:40.140Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDH75HJG5ENMJARZ5SHVN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:40.135" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1828gitlab # [ 239.692055] gitlab-workhorse[827]: time="2026-10-17T17:26:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671829gitlab # [ 239.692492] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 401830gitlab # [ 239.692984] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.134Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"590b174ef2b302bd696091cd","created_at":"2026-10-17T17:26:38.729Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.735Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-590b174ef2b302bd696091cd: start","job_status":"start","queue_duration_s":1.398713,"scheduling_latency_s":1.398726}1831gitlab # [ 239.693668] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.154Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"590b174ef2b302bd696091cd","created_at":"2026-10-17T17:26:38.729Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.735Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-590b174ef2b302bd696091cd: done: 0.02019 sec","job_status":"done","queue_duration_s":1.398713,"scheduling_latency_s":1.398726,"redis_calls":10,"redis_duration_s":0.001372,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000325,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197791,"duration_s":0.02019,"completed_at":"2026-10-17T17:26:40.154Z","load_balancing_strategy":"primary","db_duration_s":0.003009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1832gitlab # [ 239.756168] gitaly[913]: time="2026-10-17T17:26:40.141Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDH75HJG5ENMJARZ5SHVN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:40.135" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1833gitlab # [ 239.757093] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.155Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"90f0fce293f2d163dffb305e","created_at":"2026-10-17T17:26:38.750Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.755Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-90f0fce293f2d163dffb305e: start","job_status":"start","queue_duration_s":1.399775,"scheduling_latency_s":1.399787}1834gitlab # [ 239.757720] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"90f0fce293f2d163dffb305e","created_at":"2026-10-17T17:26:38.750Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.755Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-90f0fce293f2d163dffb305e: done: 0.02764 sec","job_status":"done","queue_duration_s":1.399775,"scheduling_latency_s":1.399787,"redis_calls":13,"redis_duration_s":0.002611,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000317,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001361,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000678,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000241371,"duration_s":0.02764,"completed_at":"2026-10-17T17:26:40.182Z","load_balancing_strategy":"primary","db_duration_s":0.003034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1835gitlab # [ 239.806648] gitaly[913]: time="2026-10-17T17:26:40.141Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDH75HJG5ENMJARZ5SHVN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:40.135" grpc.time_ms=5.641 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1836gitlab # [ 239.809792] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.184Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"34026b20d1313a062ca96016","created_at":"2026-10-17T17:26:38.756Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.760Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-34026b20d1313a062ca96016: start","job_status":"start","queue_duration_s":1.423142,"scheduling_latency_s":1.423157}1837gitlab # [ 239.847950] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.204Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"34026b20d1313a062ca96016","created_at":"2026-10-17T17:26:38.756Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.760Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-34026b20d1313a062ca96016: done: 0.020865 sec","job_status":"done","queue_duration_s":1.423142,"scheduling_latency_s":1.423157,"redis_calls":10,"redis_duration_s":0.001348,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209245,"duration_s":0.020865,"completed_at":"2026-10-17T17:26:40.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1838gitlab # [ 239.893692] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.205Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"20514cfc493a2ef982aabdd5","created_at":"2026-10-17T17:26:38.761Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.766Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-20514cfc493a2ef982aabdd5: start","job_status":"start","queue_duration_s":1.438967,"scheduling_latency_s":1.43898}1839gitlab # [ 239.894831] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.223Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"20514cfc493a2ef982aabdd5","created_at":"2026-10-17T17:26:38.761Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.766Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-20514cfc493a2ef982aabdd5: done: 0.017599 sec","job_status":"done","queue_duration_s":1.438967,"scheduling_latency_s":1.43898,"redis_calls":11,"redis_duration_s":0.001318,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000240254,"duration_s":0.017599,"completed_at":"2026-10-17T17:26:40.223Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002184,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1840gitlab # [ 239.942892] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.224Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f31ba83e1d9687e588e6f68b","created_at":"2026-10-17T17:26:38.770Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.774Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f31ba83e1d9687e588e6f68b: start","job_status":"start","queue_duration_s":1.449809,"scheduling_latency_s":1.449822}1841gitlab # [ 239.943668] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.243Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f31ba83e1d9687e588e6f68b","created_at":"2026-10-17T17:26:38.770Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.774Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f31ba83e1d9687e588e6f68b: done: 0.018866 sec","job_status":"done","queue_duration_s":1.449809,"scheduling_latency_s":1.449822,"redis_calls":10,"redis_duration_s":0.001214,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000188292,"duration_s":0.018866,"completed_at":"2026-10-17T17:26:40.243Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1842gitlab # [ 240.004714] gitaly[913]: time="2026-10-17T17:26:40.466Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 diskcache=9966f4c3-ff62-471b-8169-e265a2b18c97 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-17T23:26:40.458" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:40.458" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1843gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045'1844gitlab # [ 240.005471] gitaly[913]: time="2026-10-17T17:26:40.467Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-17T23:26:40.458" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:40.458" grpc.time_ms=8.102 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 240.006123] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.244Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"477d2abcc13ff3d6eae5a8b1","created_at":"2026-10-17T17:26:38.775Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.778Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-477d2abcc13ff3d6eae5a8b1: start","job_status":"start","queue_duration_s":1.465432,"scheduling_latency_s":1.465445}1846gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045', in 0.03 seconds)1847gitlab # [ 240.007398] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.267Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"477d2abcc13ff3d6eae5a8b1","created_at":"2026-10-17T17:26:38.775Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.778Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-477d2abcc13ff3d6eae5a8b1: done: 0.02298 sec","job_status":"done","queue_duration_s":1.465432,"scheduling_latency_s":1.465445,"redis_calls":10,"redis_duration_s":0.001128,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000219,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000214,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207568,"duration_s":0.02298,"completed_at":"2026-10-17T17:26:40.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1848gitlab # [ 240.046819] gitaly[913]: time="2026-10-17T17:26:40.494Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:10.393" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:40.493" grpc.time_ms=0.419 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 240.056033] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.268Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e52468ff7f89cac598002658","created_at":"2026-10-17T17:26:38.783Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.785Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e52468ff7f89cac598002658: start","job_status":"start","queue_duration_s":1.482183,"scheduling_latency_s":1.482196}1850gitlab # [ 240.095736] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.292Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e52468ff7f89cac598002658","created_at":"2026-10-17T17:26:38.783Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.785Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e52468ff7f89cac598002658: done: 0.024611 sec","job_status":"done","queue_duration_s":1.482183,"scheduling_latency_s":1.482196,"redis_calls":10,"redis_duration_s":0.001209,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000218,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200584,"duration_s":0.024611,"completed_at":"2026-10-17T17:26:40.292Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1851gitlab # [ 240.110257] nixbot[2618]: {"ts": "2026-10-17T17:26:40.588Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:50238 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1\" 200"}1852gitlab # [ 240.112531] gitaly[913]: time="2026-10-17T17:26:40.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-17T17:26:50.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:40.495" grpc.time_ms=5.811 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 240.124177] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.293Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"317899021703e99b7400949f","created_at":"2026-10-17T17:26:38.786Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.788Z","job_size_bytes":6,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-317899021703e99b7400949f: start","job_status":"start","queue_duration_s":1.504755,"scheduling_latency_s":1.504768}1854gitlab # [ 240.138623] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.307Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"317899021703e99b7400949f","created_at":"2026-10-17T17:26:38.786Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.788Z","job_size_bytes":6,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-317899021703e99b7400949f: done: 0.013794 sec","job_status":"done","queue_duration_s":1.504755,"scheduling_latency_s":1.504768,"redis_calls":10,"redis_duration_s":0.001454,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000215,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000264,"duration_s":0.013794,"completed_at":"2026-10-17T17:26:40.307Z","load_balancing_strategy":"primary","db_duration_s":0.001197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1855gitlab # [ 240.197868] gitaly[913]: time="2026-10-17T17:26:40.521Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-17T17:27:10.420" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:40.521" grpc.time_ms=0.546 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856gitlab # [ 240.198652] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.308Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"45e9aa59d2d49648c5439479","created_at":"2026-10-17T17:26:38.789Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.791Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-45e9aa59d2d49648c5439479: start","job_status":"start","queue_duration_s":1.516478,"scheduling_latency_s":1.51649}1857gitlab # [ 240.237308] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.389Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"45e9aa59d2d49648c5439479","created_at":"2026-10-17T17:26:38.789Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.791Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-45e9aa59d2d49648c5439479: done: 0.080776 sec","job_status":"done","queue_duration_s":1.516478,"scheduling_latency_s":1.51649,"redis_calls":10,"redis_duration_s":0.001119,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000218,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191924,"duration_s":0.080776,"completed_at":"2026-10-17T17:26:40.389Z","load_balancing_strategy":"primary","db_duration_s":0.003602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1858gitlab # [ 240.239700] gitaly[913]: time="2026-10-17T17:26:40.525Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=31 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-17T17:27:10.423" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:40.523" grpc.time_ms=1.347 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1859gitlab # [ 240.279343] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.390Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"3677d4fa592bf1e839b51ec9","created_at":"2026-10-17T17:26:38.795Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.798Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-3677d4fa592bf1e839b51ec9: start","job_status":"start","queue_duration_s":1.591786,"scheduling_latency_s":1.591804}1860gitlab # [ 240.280088] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.430Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"3677d4fa592bf1e839b51ec9","created_at":"2026-10-17T17:26:38.795Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.798Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-3677d4fa592bf1e839b51ec9: done: 0.040046 sec","job_status":"done","queue_duration_s":1.591786,"scheduling_latency_s":1.591804,"redis_calls":14,"redis_duration_s":0.0029000000000000002,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000255898,"duration_s":0.040046,"completed_at":"2026-10-17T17:26:40.430Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1861gitlab # [ 240.322117] gitaly[913]: time="2026-10-17T17:26:40.547Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:50.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:40.541" grpc.time_ms=5.297 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862gitlab # [ 240.322473] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.431Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2c7ea82896e9d9a546734c48","created_at":"2026-10-17T17:26:38.881Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.883Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2c7ea82896e9d9a546734c48: start","job_status":"start","queue_duration_s":1.547752,"scheduling_latency_s":1.547766}1863gitlab # [ 240.368715] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.447Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2c7ea82896e9d9a546734c48","created_at":"2026-10-17T17:26:38.881Z","trace_propagation_headers":{"sentry-trace":"cd1d432abf934b71952f351e1d1d7baf-c59f18be92ac48a9","baggage":"sentry-trace_id=cd1d432abf934b71952f351e1d1d7baf,sentry-release=Unknown"},"correlation_id":"01M55EC7F10P6MNZPMTMDJEHCZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.883Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2c7ea82896e9d9a546734c48: done: 0.015934 sec","job_status":"done","queue_duration_s":1.547752,"scheduling_latency_s":1.547766,"redis_calls":8,"redis_duration_s":0.001007,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015934,"completed_at":"2026-10-17T17:26:40.447Z","load_balancing_strategy":"primary","db_duration_s":0.002455,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1864gitlab # [ 240.369754] gitaly[913]: time="2026-10-17T17:26:40.842Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-17T17:27:10.727" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:40.827" grpc.time_ms=14.969 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 240.409981] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.448Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"21fc2a6935ab8adfecdf3522","created_at":"2026-10-17T17:26:38.944Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-564ceffe391d4d8b","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"3787489eb54b10f99943e05a","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.945Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-21fc2a6935ab8adfecdf3522: start","job_status":"start","queue_duration_s":1.502497,"scheduling_latency_s":1.50251}1866gitlab # [ 240.410382] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.475Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"21fc2a6935ab8adfecdf3522","created_at":"2026-10-17T17:26:38.944Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-564ceffe391d4d8b","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"3787489eb54b10f99943e05a","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:38.945Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-21fc2a6935ab8adfecdf3522: done: 0.027654 sec","job_status":"done","queue_duration_s":1.502497,"scheduling_latency_s":1.50251,"gitaly_calls":1,"gitaly_duration_s":0.009667,"redis_calls":12,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000333,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01691891,"duration_s":0.027654,"completed_at":"2026-10-17T17:26:40.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1867gitlab # [ 240.451203] gitaly[913]: time="2026-10-17T17:26:40.852Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDD059ECW2HH77G3V8MF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-17T17:27:10.744" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:40.844" grpc.time_ms=7.776 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 240.451949] nixbot[2618]: {"ts": "2026-10-17T17:26:40.902Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "1ebcb985-ebf9-48e4-8e9f-7eb93709019d", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "0bf727147db4ad4b5f61597b2acf332f6a704045", "pr": null}1869gitlab # [ 240.453985] nixbot[2618]: {"ts": "2026-10-17T17:26:40.905Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:50240 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1870gitlab # [ 240.455814] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.476Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ea56a6b1e4c59de0ab3d31ed","created_at":"2026-10-17T17:26:39.014Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-564ceffe391d4d8b","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b5bf814bd35fccd14de6f2b7d80a88d7f1d9bb07831f1e37e5f6ffc87547e1ad","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:39.016Z","job_size_bytes":467,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ea56a6b1e4c59de0ab3d31ed: start","job_status":"start","queue_duration_s":1.460387,"scheduling_latency_s":1.460401}1871gitlab # [ 240.509080] sidekiq-cluster[2495]: {"severity":"WARN","time":"2026-10-17T17:26:40.866Z","class":"CreatePipelineWorker","correlation_id":"01M55EDD059ECW2HH77G3V8MF4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c","after":"0bf727147db4ad4b5f61597b2acf332f6a704045","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"0bf727147db4ad4b5f61597b2acf332f6a704045","ref":"refs/heads/master"},"retry":0}1872gitlab # [ 240.509812] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.873Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ea56a6b1e4c59de0ab3d31ed","created_at":"2026-10-17T17:26:39.014Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-564ceffe391d4d8b","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b5bf814bd35fccd14de6f2b7d80a88d7f1d9bb07831f1e37e5f6ffc87547e1ad","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:39.016Z","job_size_bytes":467,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ea56a6b1e4c59de0ab3d31ed: done: 0.396234 sec","job_status":"done","queue_duration_s":1.460387,"scheduling_latency_s":1.460401,"gitaly_calls":7,"gitaly_duration_s":0.047225,"redis_calls":33,"redis_duration_s":0.00414,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000341,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001826,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000826,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.337257,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.396234,"completed_at":"2026-10-17T17:26:40.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010812,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1873gitlab # [ 240.549072] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.875Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"caf4d709-949b-4132-9886-812f7a605f84\"}"],"class":"WebHookWorker","jid":"1f623f59ab331b13c19e8a2d","created_at":"2026-10-17T17:26:39.028Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-564ceffe391d4d8b","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c612e93528cd3f4a5d3733c46b505533468f134c4488409400bfde9cd37f9918","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:39.031Z","job_size_bytes":1749,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1f623f59ab331b13c19e8a2d: start","job_status":"start","queue_duration_s":1.844074,"scheduling_latency_s":1.844106}1874gitlab # [ 240.549801] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.913Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"caf4d709-949b-4132-9886-812f7a605f84\"}"],"class":"WebHookWorker","jid":"1f623f59ab331b13c19e8a2d","created_at":"2026-10-17T17:26:39.028Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-564ceffe391d4d8b","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c612e93528cd3f4a5d3733c46b505533468f134c4488409400bfde9cd37f9918","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:39.031Z","job_size_bytes":1749,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1f623f59ab331b13c19e8a2d: done: 0.03888 sec","job_status":"done","queue_duration_s":1.844074,"scheduling_latency_s":1.844106,"redis_calls":14,"redis_duration_s":0.002183,"redis_read_bytes":25,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000298,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000694,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.00669582399999058,"cpu_s":0.0248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.03888,"completed_at":"2026-10-17T17:26:40.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1875gitlab # [ 240.605732] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.914Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"6ddebe2d64a5ae75c5fb35f4","created_at":"2026-10-17T17:26:39.218Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-10e4498217f747cc","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:39.222Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-6ddebe2d64a5ae75c5fb35f4: start","job_status":"start","queue_duration_s":1.692173,"scheduling_latency_s":1.692188}1876gitlab # [ 240.606673] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"6ddebe2d64a5ae75c5fb35f4","created_at":"2026-10-17T17:26:39.218Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-10e4498217f747cc","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:39.222Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-6ddebe2d64a5ae75c5fb35f4: done: 0.027206 sec","job_status":"done","queue_duration_s":1.692173,"scheduling_latency_s":1.692188,"redis_calls":19,"redis_duration_s":0.002307,"redis_read_bytes":21,"redis_write_bytes":4289,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00031,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2260,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00431675,"duration_s":0.027206,"completed_at":"2026-10-17T17:26:40.942Z","load_balancing_strategy":"primary","db_duration_s":0.004327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1877gitlab # [ 240.661616] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.943Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","84f693972fd1b799444206be"],"class":"WebHooks::LogExecutionWorker","jid":"071f452a8b7ad523f7325f6a","created_at":"2026-10-17T17:26:40.048Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-12748d7f90fd4a1a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e98eeee12ab55fa633c59c4624e8e81474b57cad1d4fe2a36255863754bdcf0d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:40.052Z","job_size_bytes":2593,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-071f452a8b7ad523f7325f6a: start","job_status":"start","queue_duration_s":0.890253,"scheduling_latency_s":0.890267}1878gitlab # [ 240.662511] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.969Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","84f693972fd1b799444206be"],"class":"WebHooks::LogExecutionWorker","jid":"071f452a8b7ad523f7325f6a","created_at":"2026-10-17T17:26:40.048Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-12748d7f90fd4a1a","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e98eeee12ab55fa633c59c4624e8e81474b57cad1d4fe2a36255863754bdcf0d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:40.052Z","job_size_bytes":2593,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-071f452a8b7ad523f7325f6a: done: 0.026533 sec","job_status":"done","queue_duration_s":0.890253,"scheduling_latency_s":0.890267,"redis_calls":10,"redis_duration_s":0.001253,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203937,"duration_s":0.026533,"completed_at":"2026-10-17T17:26:40.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1879gitlab # [ 240.686623] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.970Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1f623f59ab331b13c19e8a2d"],"class":"WebHooks::LogExecutionWorker","jid":"03de170abb870bbc9008ffed","created_at":"2026-10-17T17:26:40.906Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-ed5d3d40899245a5","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3fe65de1e64f996f19d8ed1a881f340d9b6908d1cc628916008431a59bc6ff09","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:40.908Z","job_size_bytes":2592,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-03de170abb870bbc9008ffed: start","job_status":"start","queue_duration_s":0.061948,"scheduling_latency_s":0.061961}1880gitlab # [ 240.701678] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.985Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1f623f59ab331b13c19e8a2d"],"class":"WebHooks::LogExecutionWorker","jid":"03de170abb870bbc9008ffed","created_at":"2026-10-17T17:26:40.906Z","trace_propagation_headers":{"sentry-trace":"6c2672056a564da7952cff426023528e-ed5d3d40899245a5","baggage":"sentry-trace_id=6c2672056a564da7952cff426023528e,sentry-release=Unknown"},"correlation_id":"01M55EDD059ECW2HH77G3V8MF4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3fe65de1e64f996f19d8ed1a881f340d9b6908d1cc628916008431a59bc6ff09","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:40.908Z","job_size_bytes":2592,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-03de170abb870bbc9008ffed: done: 0.014652 sec","job_status":"done","queue_duration_s":0.061948,"scheduling_latency_s":0.061961,"redis_calls":7,"redis_duration_s":0.001034,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000358,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014652,"completed_at":"2026-10-17T17:26:40.985Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1881gitlab # [ 240.752621] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:40.986Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"5d9716a96b8d34bfc71098fd","created_at":"2026-10-17T17:26:40.934Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-2933f2c4c4c44d79","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:40.937Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-5d9716a96b8d34bfc71098fd: start","job_status":"start","queue_duration_s":0.048847,"scheduling_latency_s":0.048861}1882gitlab # [ 240.753476] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:41.037Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"5d9716a96b8d34bfc71098fd","created_at":"2026-10-17T17:26:40.934Z","trace_propagation_headers":{"sentry-trace":"4f72fcb946544dc2a108a671f06ac365-2933f2c4c4c44d79","baggage":"sentry-trace_id=4f72fcb946544dc2a108a671f06ac365,sentry-release=Unknown"},"correlation_id":"01M55EC3SQN9TP4KV8RJSK2NKX","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:40.937Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-5d9716a96b8d34bfc71098fd: done: 0.051197 sec","job_status":"done","queue_duration_s":0.048847,"scheduling_latency_s":0.048861,"redis_calls":11,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000202819,"duration_s":0.051197,"completed_at":"2026-10-17T17:26:41.037Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1883gitlab # [ 240.845834] gitaly[913]: time="2026-10-17T17:26:41.378Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDH8E7J5MN55M1ZHBBDZX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:40.173" pid=913 remote_ip="2001:db8:1::1" request_sha=7878cb9216efc481516473f838246cc7f32e82af response_bytes=336 span.kind=server system=grpc1884gitlab # [ 240.846280] gitaly[913]: time="2026-10-17T17:26:41.378Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=1203 command.spawn_token_fork_ms=1186 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDH8E7J5MN55M1ZHBBDZX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:40.173" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1885gitlab # [ 240.846981] gitaly[913]: time="2026-10-17T17:26:41.378Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=1203 command.spawn_token_fork_ms=1186 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDH8E7J5MN55M1ZHBBDZX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:40.173" grpc.time_ms=1205.19 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1886gitlab # [ 240.847901] gitlab-workhorse[827]: time="2026-10-17T17:26:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3361887gitlab # [ 240.848502] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 12361888gitlab # [ 240.886037] nixbot[2618]: {"ts": "2026-10-17T17:26:41.418Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1889gitlab # [ 240.890434] nixbot[2618]: {"ts": "2026-10-17T17:26:41.422Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c"}1890gitlab # [ 240.934548] gitaly[913]: time="2026-10-17T17:26:41.466Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJGG2Z99YBT15298447G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:41.457" grpc.time_ms=9.514 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1891gitlab # [ 240.946226] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421892gitlab # [ 240.993714] gitaly[913]: time="2026-10-17T17:26:41.525Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:11.224" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:41.524" grpc.time_ms=0.644 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045'1894gitlab # [ 241.065057] gitaly[913]: time="2026-10-17T17:26:41.597Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:51.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:41.586" grpc.time_ms=10.453 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895gitlab # [ 241.079057] gitaly[913]: time="2026-10-17T17:26:41.611Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJHWP38JK4S8GWR71V34 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:41.605" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1896gitlab # [ 241.079705] gitaly[913]: time="2026-10-17T17:26:41.611Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJHWP38JK4S8GWR71V34 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:41.605" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1897gitlab # [ 241.081244] gitaly[913]: time="2026-10-17T17:26:41.612Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJHWP38JK4S8GWR71V34 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:41.605" grpc.time_ms=7.521 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1898gitlab # [ 241.081927] gitlab-workhorse[827]: time="2026-10-17T17:26:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671899gitlab # [ 241.082539] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1441900gitlab # [ 241.093569] nixbot[2618]: {"ts": "2026-10-17T17:26:41.625Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:50242 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1\" 200"}1901gitlab # [ 241.101729] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:41.633Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a6a40ad30b790c81820e379e","created_at":"2026-10-17T17:26:41.628Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-552ae8084a744fba","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.631Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a6a40ad30b790c81820e379e: start","job_status":"start","queue_duration_s":0.001843,"scheduling_latency_s":0.001871}1902gitlab # [ 241.119620] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2091903gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045', in 0.08 seconds)1904gitlab # [ 241.174790] gitaly[913]: time="2026-10-17T17:26:41.707Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:41.706" grpc.time_ms=0.288 pid=913 span.kind=server system=grpc1905gitlab # [ 241.180344] gitaly[913]: time="2026-10-17T17:26:41.712Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJR6CGXA1BP8CAVRR2FM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:11.711" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:41.711" grpc.time_ms=0.793 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 241.204497] gitaly[913]: time="2026-10-17T17:26:41.735Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJRXBDBFD3GXSAQ0YVCB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:41.728" grpc.time_ms=7.038 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1907gitlab # [ 241.204897] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421908gitlab # [ 241.215511] gitaly[913]: time="2026-10-17T17:26:41.747Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:41.746" grpc.time_ms=0.914 pid=913 span.kind=server system=grpc1909gitlab # [ 241.240505] gitaly[913]: time="2026-10-17T17:26:41.772Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJR6CGXA1BP8CAVRR2FM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:51.287" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:41.767" grpc.time_ms=5.371 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 241.254032] gitaly[913]: time="2026-10-17T17:26:41.786Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:41.785" grpc.time_ms=0.285 pid=913 span.kind=server system=grpc1911gitlab # [ 241.269483] gitaly[913]: time="2026-10-17T17:26:41.801Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ diskcache=8f22c32b-8166-4d99-9a47-ba9c2db055d0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:11.588" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:41.688" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912gitlab # [ 241.281973] gitaly[913]: time="2026-10-17T17:26:41.811Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=70 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7488 command.oublock=0 command.real_time_ms=106 command.spawn_token_fork_ms=0 command.system_time_ms=53 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:11.588" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:41.688" grpc.time_ms=113.164 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1913gitlab # [ 241.282521] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1401914gitlab # [ 241.287167] gitaly[913]: time="2026-10-17T17:26:41.818Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJTZ0G74MPC8B05RYFSD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:41.799" pid=913 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1915gitlab # [ 241.288611] gitlab-workhorse[827]: time="2026-10-17T17:26:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161916gitlab # [ 241.289461] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 591917gitlab # [ 241.289949] gitaly[913]: time="2026-10-17T17:26:41.818Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1156 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJTZ0G74MPC8B05RYFSD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:41.799" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1918gitlab # [ 241.290635] gitaly[913]: time="2026-10-17T17:26:41.818Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1156 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJTZ0G74MPC8B05RYFSD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:41.799" grpc.time_ms=19.463 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1919gitlab # [ 241.372942] gitaly[913]: time="2026-10-17T17:26:41.905Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJWVKVSAHSJC3HHMB6ZN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:11.804" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:41.904" grpc.time_ms=0.417 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920gitlab # [ 241.385073] gitaly[913]: time="2026-10-17T17:26:41.917Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-17T17:27:11.804" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:41.904" grpc.time_ms=0.454 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921gitlab # [ 241.398802] gitaly[913]: time="2026-10-17T17:26:41.931Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:11.630" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:41.930" grpc.time_ms=0.359 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922gitlab # [ 241.401943] gitaly[913]: time="2026-10-17T17:26:41.934Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJWVKVSAHSJC3HHMB6ZN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:51.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:41.925" grpc.time_ms=8.658 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923gitlab # [ 241.407952] gitaly[913]: time="2026-10-17T17:26:41.940Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:11.839" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:41.939" grpc.time_ms=0.386 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924gitlab # [ 241.433961] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e2f11a4f44c6cb1fc5546a40f062a4589cb3c03c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1461925gitlab # [ 241.439741] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:41.971Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9f9837678b321c21804638a7","created_at":"2026-10-17T17:26:41.970Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"a6a40ad30b790c81820e379e","job_size_bytes":3,"pid":2495,"job_status":"deduplicated","message":"PipelineProcessWorker JID-9f9837678b321c21804638a7: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1926gitlab # [ 241.455065] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:41.987Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a6a40ad30b790c81820e379e","created_at":"2026-10-17T17:26:41.628Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-552ae8084a744fba","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.631Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2495,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a6a40ad30b790c81820e379e: rescheduled"}1927gitlab # [ 241.461077] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:41.992Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a6a40ad30b790c81820e379e","created_at":"2026-10-17T17:26:41.628Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-552ae8084a744fba","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.631Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a6a40ad30b790c81820e379e: done: 0.359488 sec","job_status":"done","queue_duration_s":0.001843,"scheduling_latency_s":0.001871,"gitaly_calls":3,"gitaly_duration_s":0.141794,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025134,"redis_read_bytes":226,"redis_write_bytes":18467,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000342,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000632,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002344,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.019545,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000141,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000393,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001395,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.081,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":18,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105413,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.285066398,"duration_s":0.359488,"completed_at":"2026-10-17T17:26:41.992Z","load_balancing_strategy":"primary","db_duration_s":0.082053,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1928gitlab # [ 241.475337] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:41.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f865a175f7a752730030ebc6","created_at":"2026-10-17T17:26:41.681Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.683Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f865a175f7a752730030ebc6: start","job_status":"start","queue_duration_s":0.310477,"scheduling_latency_s":0.310495}1929gitlab # [ 241.526857] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.045Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f865a175f7a752730030ebc6","created_at":"2026-10-17T17:26:41.681Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.683Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f865a175f7a752730030ebc6: done: 0.052 sec","job_status":"done","queue_duration_s":0.310477,"scheduling_latency_s":0.310495,"redis_calls":7,"redis_duration_s":0.019563,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052,"completed_at":"2026-10-17T17:26:42.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009627,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1930gitlab # [ 241.528406] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.047Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"fe8404f54b580d21c3741bf6","created_at":"2026-10-17T17:26:41.867Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.870Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-fe8404f54b580d21c3741bf6: start","job_status":"start","queue_duration_s":0.17669,"scheduling_latency_s":0.176705}1931gitlab # [ 241.575269] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.066Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"fe8404f54b580d21c3741bf6","created_at":"2026-10-17T17:26:41.867Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.870Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-fe8404f54b580d21c3741bf6: done: 0.019782 sec","job_status":"done","queue_duration_s":0.17669,"scheduling_latency_s":0.176705,"redis_calls":7,"redis_duration_s":0.003855,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00299,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019782,"completed_at":"2026-10-17T17:26:42.066Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1932gitlab # [ 241.580828] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.068Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6fc55db43eb13734ae17c8ab","created_at":"2026-10-17T17:26:41.876Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.878Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6fc55db43eb13734ae17c8ab: start","job_status":"start","queue_duration_s":0.190249,"scheduling_latency_s":0.190263}1933gitlab # [ 241.595128] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.084Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6fc55db43eb13734ae17c8ab","created_at":"2026-10-17T17:26:41.876Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.878Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6fc55db43eb13734ae17c8ab: done: 0.015704 sec","job_status":"done","queue_duration_s":0.190249,"scheduling_latency_s":0.190263,"redis_calls":7,"redis_duration_s":0.000854,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015704,"completed_at":"2026-10-17T17:26:42.084Z","load_balancing_strategy":"primary","db_duration_s":0.002507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1934gitlab # [ 241.648130] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.085Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7504b502b94650cd1c8f4638","created_at":"2026-10-17T17:26:41.884Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.885Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7504b502b94650cd1c8f4638: start","job_status":"start","queue_duration_s":0.200038,"scheduling_latency_s":0.200051}1935gitlab # [ 241.648835] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.102Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7504b502b94650cd1c8f4638","created_at":"2026-10-17T17:26:41.884Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.885Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7504b502b94650cd1c8f4638: done: 0.017307 sec","job_status":"done","queue_duration_s":0.200038,"scheduling_latency_s":0.200051,"redis_calls":10,"redis_duration_s":0.001433,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000396,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017307,"completed_at":"2026-10-17T17:26:42.102Z","load_balancing_strategy":"primary","db_duration_s":0.002806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1936gitlab # [ 241.693752] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.103Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0ce06d947acb4d44dc5d2ce7","created_at":"2026-10-17T17:26:41.885Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.886Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0ce06d947acb4d44dc5d2ce7: start","job_status":"start","queue_duration_s":0.216706,"scheduling_latency_s":0.21672}1937gitlab # [ 241.698929] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.124Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0ce06d947acb4d44dc5d2ce7","created_at":"2026-10-17T17:26:41.885Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.886Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0ce06d947acb4d44dc5d2ce7: done: 0.020919 sec","job_status":"done","queue_duration_s":0.216706,"scheduling_latency_s":0.21672,"redis_calls":7,"redis_duration_s":0.002402,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020919,"completed_at":"2026-10-17T17:26:42.124Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1938gitlab # [ 241.747765] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7f96607eb1ca2965e9e1d28b","created_at":"2026-10-17T17:26:41.887Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.888Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7f96607eb1ca2965e9e1d28b: start","job_status":"start","queue_duration_s":0.236949,"scheduling_latency_s":0.23697}1939gitlab # [ 241.751196] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.141Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7f96607eb1ca2965e9e1d28b","created_at":"2026-10-17T17:26:41.887Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.888Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7f96607eb1ca2965e9e1d28b: done: 0.016151 sec","job_status":"done","queue_duration_s":0.236949,"scheduling_latency_s":0.23697,"redis_calls":8,"redis_duration_s":0.001038,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016151,"completed_at":"2026-10-17T17:26:42.141Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1940gitlab # [ 241.792506] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.142Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9ddefdd6051874f3b096d11b","created_at":"2026-10-17T17:26:41.889Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.891Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9ddefdd6051874f3b096d11b: start","job_status":"start","queue_duration_s":0.251175,"scheduling_latency_s":0.25119}1941gitlab # [ 241.803716] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.155Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9ddefdd6051874f3b096d11b","created_at":"2026-10-17T17:26:41.889Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.891Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9ddefdd6051874f3b096d11b: done: 0.012637 sec","job_status":"done","queue_duration_s":0.251175,"scheduling_latency_s":0.25119,"redis_calls":7,"redis_duration_s":0.0008510000000000001,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012637,"completed_at":"2026-10-17T17:26:42.155Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1942gitlab # [ 241.846615] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.156Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"90a2be4bb3b8f96afbfe5663","created_at":"2026-10-17T17:26:41.892Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.893Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-90a2be4bb3b8f96afbfe5663: start","job_status":"start","queue_duration_s":0.262559,"scheduling_latency_s":0.26259}1943gitlab # [ 241.889836] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.175Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"90a2be4bb3b8f96afbfe5663","created_at":"2026-10-17T17:26:41.892Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.893Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-90a2be4bb3b8f96afbfe5663: done: 0.01928 sec","job_status":"done","queue_duration_s":0.262559,"scheduling_latency_s":0.26259,"redis_calls":7,"redis_duration_s":0.00092,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01928,"completed_at":"2026-10-17T17:26:42.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1944gitlab # [ 241.893623] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.176Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2e1ab5bb02a0efcecd7fd980","created_at":"2026-10-17T17:26:41.894Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.895Z","job_size_bytes":6,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2e1ab5bb02a0efcecd7fd980: start","job_status":"start","queue_duration_s":0.281335,"scheduling_latency_s":0.281349}1945gitlab # [ 241.945861] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.185Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2e1ab5bb02a0efcecd7fd980","created_at":"2026-10-17T17:26:41.894Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.895Z","job_size_bytes":6,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2e1ab5bb02a0efcecd7fd980: done: 0.008462 sec","job_status":"done","queue_duration_s":0.281335,"scheduling_latency_s":0.281349,"redis_calls":7,"redis_duration_s":0.000998,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008462,"completed_at":"2026-10-17T17:26:42.185Z","load_balancing_strategy":"primary","db_duration_s":0.000364,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1946gitlab # [ 241.947322] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.185Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"776e6c3e9c683db5e30a9c3f","created_at":"2026-10-17T17:26:41.895Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.896Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-776e6c3e9c683db5e30a9c3f: start","job_status":"start","queue_duration_s":0.289344,"scheduling_latency_s":0.289357}1947gitlab # [ 241.992348] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.199Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"776e6c3e9c683db5e30a9c3f","created_at":"2026-10-17T17:26:41.895Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.896Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-776e6c3e9c683db5e30a9c3f: done: 0.013383 sec","job_status":"done","queue_duration_s":0.289344,"scheduling_latency_s":0.289357,"redis_calls":7,"redis_duration_s":0.000942,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013383,"completed_at":"2026-10-17T17:26:42.199Z","load_balancing_strategy":"primary","db_duration_s":0.002161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1948gitlab # [ 241.996236] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.200Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"23835b57af824fe84522a10f","created_at":"2026-10-17T17:26:41.987Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.988Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-23835b57af824fe84522a10f: start","job_status":"start","queue_duration_s":0.211313,"scheduling_latency_s":0.211326}1949gitlab # [ 242.061305] gitaly[913]: time="2026-10-17T17:26:42.590Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=434176 command.minflt=635 command.oublock=0 command.real_time_ms=547 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDK25FME7B9S3WMZJK6SC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:42.042" grpc.time_ms=548.162 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1950gitlab # [ 242.062554] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 6021951gitlab # [ 242.064741] gitaly[913]: time="2026-10-17T17:26:42.596Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=60 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=430080 command.minflt=647 command.oublock=0 command.real_time_ms=619 command.spawn_token_fork_ms=12 command.system_time_ms=60 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-17T17:27:11.675" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:41.975" grpc.time_ms=621.314 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab # [ 242.101116] gitaly[913]: time="2026-10-17T17:26:42.633Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:42.632" grpc.time_ms=0.571 pid=913 span.kind=server system=grpc1953gitlab # [ 242.103618] gitaly[913]: time="2026-10-17T17:26:42.635Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:52.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:42.628" grpc.time_ms=7.157 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045'1955gitlab # [ 242.138218] gitaly[913]: time="2026-10-17T17:26:42.670Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-17T17:26:52.087" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:42.667" grpc.time_ms=0.283 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 242.139290] gitaly[913]: time="2026-10-17T17:26:42.671Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:42.670" grpc.time_ms=0.644 pid=913 span.kind=server system=grpc1957gitlab # [ 242.157972] gitaly[913]: time="2026-10-17T17:26:42.690Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=11 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-17T17:26:52.093" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:42.673" grpc.time_ms=16.365 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045', in 0.04 seconds)1959(finished: subtest: push delivers the webhook, in 46.32 seconds)1960subtest: eval and build post commit statuses1961gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses1962gitlab # [ 242.177902] gitaly[913]: time="2026-10-17T17:26:42.710Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDKN1T76HTCAF4WHJ78P2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:42.701" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1963gitlab # [ 242.178277] gitaly[913]: time="2026-10-17T17:26:42.710Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDKN1T76HTCAF4WHJ78P2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:42.701" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1964gitlab # [ 242.178868] gitaly[913]: time="2026-10-17T17:26:42.710Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDKN1T76HTCAF4WHJ78P2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:42.701" grpc.time_ms=8.873 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1965gitlab # [ 242.179523] gitlab-workhorse[827]: time="2026-10-17T17:26:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671966gitlab # [ 242.179965] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1171967gitlab # [ 242.181967] nixbot[2618]: {"ts": "2026-10-17T17:26:42.711Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:50254 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1\" 200"}1968gitlab # [ 242.188088] gitaly[913]: time="2026-10-17T17:26:42.719Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:42.719" grpc.time_ms=0.248 pid=913 span.kind=server system=grpc1969gitlab # [ 242.236863] gitaly[913]: time="2026-10-17T17:26:42.768Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:42.768" grpc.time_ms=0.317 pid=913 span.kind=server system=grpc1970gitlab # [ 242.244471] gitaly[913]: time="2026-10-17T17:26:42.776Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ diskcache=2e992fbe-71c3-48dc-933d-1b539ba77e43 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:12.138" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:42.238" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1971gitlab # [ 242.245233] gitaly[913]: time="2026-10-17T17:26:42.776Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=138 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=827392 command.minflt=7407 command.oublock=0 command.real_time_ms=520 command.spawn_token_fork_ms=0 command.system_time_ms=111 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:12.138" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:42.238" grpc.time_ms=537.97 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1972gitlab # [ 242.275835] gitaly[913]: time="2026-10-17T17:26:42.808Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDKSC4WF39RESWPZN9N5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:12.507" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:42.807" grpc.time_ms=0.442 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 242.302436] gitaly[913]: time="2026-10-17T17:26:42.834Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:42.834" grpc.time_ms=0.344 pid=913 span.kind=server system=grpc1974gitlab # [ 242.313886] gitaly[913]: time="2026-10-17T17:26:42.844Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:52.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:42.705" operations="[repack_refs]" pid=913 ref=refs/keep-around/0bf727147db4ad4b5f61597b2acf332f6a704045 remote_ip="2001:db8:1::1" revision=0bf727147db4ad4b5f61597b2acf332f6a704045 span.kind=server system=grpc username=root1975gitlab # [ 242.314759] gitaly[913]: time="2026-10-17T17:26:42.846Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:52.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:42.705" pid=913 ref=refs/keep-around/0bf727147db4ad4b5f61597b2acf332f6a704045 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-17 17:25:46.557035161 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=0bf727147db4ad4b5f61597b2acf332f6a704045 span.kind=server system=grpc username=root1976gitlab # [ 242.318583] gitaly[913]: time="2026-10-17T17:26:42.850Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM diskcache=07d409dd-9a6b-4cf5-8105-582288330338 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:52.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:42.705" pid=913 ref=refs/keep-around/0bf727147db4ad4b5f61597b2acf332f6a704045 remote_ip="2001:db8:1::1" revision=0bf727147db4ad4b5f61597b2acf332f6a704045 span.kind=server system=grpc username=root1977gitlab # [ 242.319468] gitaly[913]: time="2026-10-17T17:26:42.851Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=43 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5081 command.oublock=8 command.real_time_ms=137 command.spawn_token_fork_ms=2 command.system_time_ms=29 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:52.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:42.705" grpc.time_ms=145.144 pid=913 ref=refs/keep-around/0bf727147db4ad4b5f61597b2acf332f6a704045 remote_ip="2001:db8:1::1" revision=0bf727147db4ad4b5f61597b2acf332f6a704045 span.kind=server system=grpc username=root1978gitlab # [ 242.324681] gitaly[913]: time="2026-10-17T17:26:42.856Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDKV40KQWMRFXJVVQB6SP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:42.849" grpc.time_ms=7.509 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1979gitlab # [ 242.332619] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 691980gitlab # [ 242.334487] gitaly[913]: time="2026-10-17T17:26:42.865Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:52.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:42.705" pid=913 ref=refs/keep-around/0bf727147db4ad4b5f61597b2acf332f6a704045 remote_ip="2001:db8:1::1" revision=0bf727147db4ad4b5f61597b2acf332f6a704045 span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root1981gitlab # [ 242.380617] gitaly[913]: time="2026-10-17T17:26:42.865Z" level=info msg="optimized repository" clean_stale_data_time=17.84724ms clean_work_trees_time="65.93µs" commit_graph_time="3.352µs" correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=913 prune_time="3.632µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.352µs" storage_name=default system=housekeeping total_time=18.017374ms1982gitlab # [ 242.381563] gitaly[913]: time="2026-10-17T17:26:42.865Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T17:26:52.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T17:26:42.705" pid=913 ref=refs/keep-around/0bf727147db4ad4b5f61597b2acf332f6a704045 remote_ip="2001:db8:1::1" revision=0bf727147db4ad4b5f61597b2acf332f6a704045 span.kind=server system=grpc username=root1983gitlab # [ 242.382173] gitaly[913]: time="2026-10-17T17:26:42.895Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDKXABEK1H1VNMCFPAXHJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:42.889" pid=913 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1984gitlab # [ 242.382664] gitlab-workhorse[827]: time="2026-10-17T17:26:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671985gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses, in 0.23 seconds)1986gitlab # [ 242.383117] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 371987gitlab # [ 242.383628] gitaly[913]: time="2026-10-17T17:26:42.895Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDKXABEK1H1VNMCFPAXHJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:42.889" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1988gitlab # [ 242.387698] gitaly[913]: time="2026-10-17T17:26:42.896Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDKXABEK1H1VNMCFPAXHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:42.889" grpc.time_ms=6.429 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1989gitlab # [ 242.435731] gitaly[913]: time="2026-10-17T17:26:42.933Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-17T17:27:12.832" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:42.932" grpc.time_ms=0.531 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 242.436710] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.963Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"23835b57af824fe84522a10f","created_at":"2026-10-17T17:26:41.987Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-c75675b9dc464fee","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:41.988Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-23835b57af824fe84522a10f: done: 0.763015 sec","job_status":"done","queue_duration_s":0.211313,"scheduling_latency_s":0.211326,"gitaly_calls":3,"gitaly_duration_s":0.546116,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.02754,"redis_read_bytes":141,"redis_write_bytes":16718,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000342,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000585,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001897,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11224,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.016113,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000166,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000734,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.007361,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.112,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.093,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076801,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.742410557,"duration_s":0.763015,"completed_at":"2026-10-17T17:26:42.963Z","load_balancing_strategy":"primary","db_duration_s":0.113295,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1991gitlab # [ 242.489022] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.964Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"72345bda57153a9c4639b5f4","created_at":"2026-10-17T17:26:42.233Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.235Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-72345bda57153a9c4639b5f4: start","job_status":"start","queue_duration_s":0.729056,"scheduling_latency_s":0.729076}1992gitlab # [ 242.489765] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 2101993gitlab # [ 242.490232] gitaly[913]: time="2026-10-17T17:26:42.953Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJH1E7FNN3SJQ7D1D7GJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:12.853" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:42.953" grpc.time_ms=0.36 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994gitlab # [ 242.490922] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.989Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"72345bda57153a9c4639b5f4","created_at":"2026-10-17T17:26:42.233Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.235Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-72345bda57153a9c4639b5f4: done: 0.02505 sec","job_status":"done","queue_duration_s":0.729056,"scheduling_latency_s":0.729076,"redis_calls":7,"redis_duration_s":0.001153,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02505,"completed_at":"2026-10-17T17:26:42.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004204,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1995gitlab # [ 242.524687] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:42.990Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3778ffec5dbaf0084fd5d290","created_at":"2026-10-17T17:26:42.785Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.799Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3778ffec5dbaf0084fd5d290: start","job_status":"start","queue_duration_s":0.191052,"scheduling_latency_s":0.191066}1996gitlab # [ 242.566131] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.005Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3778ffec5dbaf0084fd5d290","created_at":"2026-10-17T17:26:42.785Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.799Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3778ffec5dbaf0084fd5d290: done: 0.014833 sec","job_status":"done","queue_duration_s":0.191052,"scheduling_latency_s":0.191066,"redis_calls":7,"redis_duration_s":0.000896,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014833,"completed_at":"2026-10-17T17:26:43.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 242.578167] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.005Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6e01d2d3ce4757dfbdd7288b","created_at":"2026-10-17T17:26:42.812Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.815Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6e01d2d3ce4757dfbdd7288b: start","job_status":"start","queue_duration_s":0.190734,"scheduling_latency_s":0.190746}1998gitlab # [ 242.619128] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.021Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6e01d2d3ce4757dfbdd7288b","created_at":"2026-10-17T17:26:42.812Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.815Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6e01d2d3ce4757dfbdd7288b: done: 0.01532 sec","job_status":"done","queue_duration_s":0.190734,"scheduling_latency_s":0.190746,"redis_calls":7,"redis_duration_s":0.0009449999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01532,"completed_at":"2026-10-17T17:26:43.021Z","load_balancing_strategy":"primary","db_duration_s":0.002455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1999gitlab # [ 242.657267] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.022Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1595a5b17c8ee6ef1096ff65","created_at":"2026-10-17T17:26:42.822Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.823Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1595a5b17c8ee6ef1096ff65: start","job_status":"start","queue_duration_s":0.198362,"scheduling_latency_s":0.198375}2000gitlab # [ 242.658076] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.038Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1595a5b17c8ee6ef1096ff65","created_at":"2026-10-17T17:26:42.822Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.823Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1595a5b17c8ee6ef1096ff65: done: 0.016829 sec","job_status":"done","queue_duration_s":0.198362,"scheduling_latency_s":0.198375,"redis_calls":10,"redis_duration_s":0.001327,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000401,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016829,"completed_at":"2026-10-17T17:26:43.038Z","load_balancing_strategy":"primary","db_duration_s":0.002465,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2001gitlab # [ 242.717541] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.039Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f85f32c0689c5a67fb6fb37a","created_at":"2026-10-17T17:26:42.824Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.825Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f85f32c0689c5a67fb6fb37a: start","job_status":"start","queue_duration_s":0.213748,"scheduling_latency_s":0.213764}2002gitlab # [ 242.718254] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.054Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f85f32c0689c5a67fb6fb37a","created_at":"2026-10-17T17:26:42.824Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.825Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f85f32c0689c5a67fb6fb37a: done: 0.014327 sec","job_status":"done","queue_duration_s":0.213748,"scheduling_latency_s":0.213764,"redis_calls":7,"redis_duration_s":0.000885,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014327,"completed_at":"2026-10-17T17:26:43.054Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002286,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2003gitlab # [ 242.758955] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.054Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"30537ef17725680b38cd1aa5","created_at":"2026-10-17T17:26:42.826Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.827Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-30537ef17725680b38cd1aa5: start","job_status":"start","queue_duration_s":0.227163,"scheduling_latency_s":0.227176}2004gitlab # [ 242.759699] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.068Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"30537ef17725680b38cd1aa5","created_at":"2026-10-17T17:26:42.826Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.827Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-30537ef17725680b38cd1aa5: done: 0.013494 sec","job_status":"done","queue_duration_s":0.227163,"scheduling_latency_s":0.227176,"redis_calls":8,"redis_duration_s":0.001049,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013494,"completed_at":"2026-10-17T17:26:43.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2005gitlab # [ 242.785623] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.069Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b4f0d7f87baddb60e5a16e8f","created_at":"2026-10-17T17:26:42.828Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.829Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b4f0d7f87baddb60e5a16e8f: start","job_status":"start","queue_duration_s":0.239954,"scheduling_latency_s":0.239968}2006gitlab # [ 242.824798] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.081Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b4f0d7f87baddb60e5a16e8f","created_at":"2026-10-17T17:26:42.828Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.829Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b4f0d7f87baddb60e5a16e8f: done: 0.012348 sec","job_status":"done","queue_duration_s":0.239954,"scheduling_latency_s":0.239968,"redis_calls":7,"redis_duration_s":0.0008799999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012348,"completed_at":"2026-10-17T17:26:43.081Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2007gitlab # [ 242.863222] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.082Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d81e53231f2b3352f62738ff","created_at":"2026-10-17T17:26:42.829Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.830Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d81e53231f2b3352f62738ff: start","job_status":"start","queue_duration_s":0.251942,"scheduling_latency_s":0.251955}2008gitlab # [ 242.863991] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.097Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d81e53231f2b3352f62738ff","created_at":"2026-10-17T17:26:42.829Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.830Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d81e53231f2b3352f62738ff: done: 0.014942 sec","job_status":"done","queue_duration_s":0.251942,"scheduling_latency_s":0.251955,"redis_calls":7,"redis_duration_s":0.000879,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014942,"completed_at":"2026-10-17T17:26:43.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2009gitlab # [ 242.915335] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.098Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0fe519d1d32eed05cdd50638","created_at":"2026-10-17T17:26:42.830Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.831Z","job_size_bytes":6,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0fe519d1d32eed05cdd50638: start","job_status":"start","queue_duration_s":0.266609,"scheduling_latency_s":0.266622}2010gitlab # [ 242.916182] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0fe519d1d32eed05cdd50638","created_at":"2026-10-17T17:26:42.830Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.831Z","job_size_bytes":6,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0fe519d1d32eed05cdd50638: done: 0.008003 sec","job_status":"done","queue_duration_s":0.266609,"scheduling_latency_s":0.266622,"redis_calls":7,"redis_duration_s":0.0008370000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008003,"completed_at":"2026-10-17T17:26:43.106Z","load_balancing_strategy":"primary","db_duration_s":0.000239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2011gitlab # [ 242.972294] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.107Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6557784c0f1f0f7d3c91ac2d","created_at":"2026-10-17T17:26:42.831Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.832Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6557784c0f1f0f7d3c91ac2d: start","job_status":"start","queue_duration_s":0.274328,"scheduling_latency_s":0.274341}2012gitlab # [ 242.973043] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.119Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6557784c0f1f0f7d3c91ac2d","created_at":"2026-10-17T17:26:42.831Z","trace_propagation_headers":{"sentry-trace":"369932a192a74a3ca8602dc0f83fe605-9c23b7bfcdf541e0","baggage":"sentry-trace_id=369932a192a74a3ca8602dc0f83fe605,sentry-release=Unknown"},"correlation_id":"01M55EDJH1E7FNN3SJQ7D1D7GJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:42.832Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6557784c0f1f0f7d3c91ac2d: done: 0.012764 sec","job_status":"done","queue_duration_s":0.274328,"scheduling_latency_s":0.274341,"redis_calls":7,"redis_duration_s":0.000857,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012764,"completed_at":"2026-10-17T17:26:43.119Z","load_balancing_strategy":"primary","db_duration_s":0.001735,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2013gitlab # [ 243.034987] gitaly[913]: time="2026-10-17T17:26:43.567Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:13.266" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:43.566" grpc.time_ms=0.484 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab # [ 243.058151] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.590Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4343223a2082e87176000738","created_at":"2026-10-17T17:26:43.583Z","trace_propagation_headers":{"sentry-trace":"062fdd09b8424ee596d883d4faf6afe3-f85d9c625b624c50","baggage":"sentry-trace_id=062fdd09b8424ee596d883d4faf6afe3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDJZ4WGJHG2TEFC35KZDM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:43.588Z","job_size_bytes":65,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4343223a2082e87176000738: start","job_status":"start","queue_duration_s":0.001256,"scheduling_latency_s":0.001287}2015gitlab # [ 243.083704] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.615Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4343223a2082e87176000738","created_at":"2026-10-17T17:26:43.583Z","trace_propagation_headers":{"sentry-trace":"062fdd09b8424ee596d883d4faf6afe3-f85d9c625b624c50","baggage":"sentry-trace_id=062fdd09b8424ee596d883d4faf6afe3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDJZ4WGJHG2TEFC35KZDM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:43.588Z","job_size_bytes":65,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4343223a2082e87176000738: done: 0.025194 sec","job_status":"done","queue_duration_s":0.001256,"scheduling_latency_s":0.001287,"redis_calls":7,"redis_duration_s":0.001271,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000324,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025194,"completed_at":"2026-10-17T17:26:43.615Z","load_balancing_strategy":"primary","db_duration_s":0.003314,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2016gitlab # [ 243.085429] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.617Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b3a8813a2928bf481a127c27","created_at":"2026-10-17T17:26:43.589Z","trace_propagation_headers":{"sentry-trace":"062fdd09b8424ee596d883d4faf6afe3-f85d9c625b624c50","baggage":"sentry-trace_id=062fdd09b8424ee596d883d4faf6afe3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDJZ4WGJHG2TEFC35KZDM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:43.593Z","job_size_bytes":65,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b3a8813a2928bf481a127c27: start","job_status":"start","queue_duration_s":0.024308,"scheduling_latency_s":0.024342}2017gitlab # [ 243.132915] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.664Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b3a8813a2928bf481a127c27","created_at":"2026-10-17T17:26:43.589Z","trace_propagation_headers":{"sentry-trace":"062fdd09b8424ee596d883d4faf6afe3-f85d9c625b624c50","baggage":"sentry-trace_id=062fdd09b8424ee596d883d4faf6afe3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDJZ4WGJHG2TEFC35KZDM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:43.593Z","job_size_bytes":65,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b3a8813a2928bf481a127c27: done: 0.04767 sec","job_status":"done","queue_duration_s":0.024308,"scheduling_latency_s":0.024342,"redis_calls":10,"redis_duration_s":0.001655,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04767,"completed_at":"2026-10-17T17:26:43.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008727,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2018gitlab # [ 243.201501] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.733Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9af5053f92bd00223863e06e","created_at":"2026-10-17T17:26:43.730Z","trace_propagation_headers":{"sentry-trace":"062fdd09b8424ee596d883d4faf6afe3-f85d9c625b624c50","baggage":"sentry-trace_id=062fdd09b8424ee596d883d4faf6afe3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDJZ4WGJHG2TEFC35KZDM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:43.732Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9af5053f92bd00223863e06e: start","job_status":"start","queue_duration_s":0.001051,"scheduling_latency_s":0.001081}2019gitlab # [ 243.222420] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 18612020gitlab # [ 243.229738] nixbot[2618]: {"ts": "2026-10-17T17:26:43.761Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-0bf727147db4-4"}2021gitlab # [ 243.280695] gitaly[913]: time="2026-10-17T17:26:43.812Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-17T17:27:13.711" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:43.811" grpc.time_ms=0.679 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 243.313755] nixbot[2618]: {"ts": "2026-10-17T17:26:43.845Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-0bf727147db4-4", "argv0": "bwrap"}2023gitlab # [ 243.326820] gitaly[913]: time="2026-10-17T17:26:43.859Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDJZ4WGJHG2TEFC35KZDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:13.757" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:43.858" grpc.time_ms=0.639 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab # [ 243.335410] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.867Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9af5053f92bd00223863e06e","created_at":"2026-10-17T17:26:43.730Z","trace_propagation_headers":{"sentry-trace":"062fdd09b8424ee596d883d4faf6afe3-f85d9c625b624c50","baggage":"sentry-trace_id=062fdd09b8424ee596d883d4faf6afe3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDJZ4WGJHG2TEFC35KZDM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:43.732Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9af5053f92bd00223863e06e: done: 0.133927 sec","job_status":"done","queue_duration_s":0.001051,"scheduling_latency_s":0.001081,"gitaly_calls":2,"gitaly_duration_s":0.005254,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.005868,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000897,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000724,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000173,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000855,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000348,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000796,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084357,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.096954222,"duration_s":0.133927,"completed_at":"2026-10-17T17:26:43.867Z","load_balancing_strategy":"primary","db_duration_s":0.041275,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2025gitlab # [ 243.378976] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.868Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c8e853e8cb7da05de79bfa99","created_at":"2026-10-17T17:26:43.800Z","trace_propagation_headers":{"sentry-trace":"062fdd09b8424ee596d883d4faf6afe3-f8a9b067d61a40ae","baggage":"sentry-trace_id=062fdd09b8424ee596d883d4faf6afe3,sentry-release=Unknown"},"correlation_id":"01M55EDJZ4WGJHG2TEFC35KZDM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:43.802Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c8e853e8cb7da05de79bfa99: start","job_status":"start","queue_duration_s":0.065974,"scheduling_latency_s":0.06599}2026gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses2027gitlab # [ 243.379896] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:43.888Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c8e853e8cb7da05de79bfa99","created_at":"2026-10-17T17:26:43.800Z","trace_propagation_headers":{"sentry-trace":"062fdd09b8424ee596d883d4faf6afe3-f8a9b067d61a40ae","baggage":"sentry-trace_id=062fdd09b8424ee596d883d4faf6afe3,sentry-release=Unknown"},"correlation_id":"01M55EDJZ4WGJHG2TEFC35KZDM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:43.802Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c8e853e8cb7da05de79bfa99: done: 0.020666 sec","job_status":"done","queue_duration_s":0.065974,"scheduling_latency_s":0.06599,"redis_calls":7,"redis_duration_s":0.0009370000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020666,"completed_at":"2026-10-17T17:26:43.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003174,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2028gitlab # [ 243.476072] gitaly[913]: time="2026-10-17T17:26:44.008Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDN09DH9GXB90NSGGCRJA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:14.006" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:44.007" grpc.time_ms=0.648 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab # [ 243.483394] nix-daemon[2777]: accepted connection from pid 3638, user nixbot2030gitlab # [ 243.494697] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 492031gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses, in 0.08 seconds)2032gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses2033gitlab # [ 244.570752] gitaly[913]: time="2026-10-17T17:26:45.102Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDP27A91Q5WPCBQ7C4SV5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:15.101" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:45.101" grpc.time_ms=0.761 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 244.597442] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 652035gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses, in 0.11 seconds)2036gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses2037gitlab # [ 245.713644] gitaly[913]: time="2026-10-17T17:26:46.245Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDQ4T5280ZT7SMNGSG443 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:16.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:46.244" grpc.time_ms=0.764 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 245.767281] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1282039gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses, in 0.17 seconds)2040gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses2041gitlab # [ 246.844067] gitaly[913]: time="2026-10-17T17:26:47.376Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDR8ZBFHHPEG6C0RGQF1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:17.374" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:47.375" grpc.time_ms=0.533 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 246.863237] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 672043gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses, in 0.09 seconds)2044gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses2045gitlab # [ 247.951664] gitaly[913]: time="2026-10-17T17:26:48.483Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSBFFZY1JTKYA95DQGXR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:18.182" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:48.482" grpc.time_ms=0.502 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046gitlab # [ 247.971593] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 712047gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses, in 0.12 seconds)2048gitlab # [ 248.144704] nix-daemon[2777]: accepted connection from pid 3675, user nixbot2049gitlab # [ 248.156967] nix-daemon[2777]: accepted connection from pid 3638, user nixbot2050gitlab # [ 248.220188] gitaly[913]: time="2026-10-17T17:26:48.752Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:18.450" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:48.751" grpc.time_ms=0.67 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 248.262930] gitaly[913]: time="2026-10-17T17:26:48.795Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:58.207" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:48.787" grpc.time_ms=7.754 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 248.293489] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:48.824Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f1a09d301290126cd0cab10f","created_at":"2026-10-17T17:26:48.820Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-96679adc6aec4230","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:48.823Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f1a09d301290126cd0cab10f: start","job_status":"start","queue_duration_s":0.001259,"scheduling_latency_s":0.001288}2053gitlab # [ 248.324133] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1412054gitlab # [ 248.385995] gitaly[913]: time="2026-10-17T17:26:48.918Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSRVMYB0MCXVC9X67T3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:18.617" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:48.917" grpc.time_ms=0.603 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 248.387776] gitaly[913]: time="2026-10-17T17:26:48.920Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:48.919" grpc.time_ms=0.224 pid=913 span.kind=server system=grpc2056gitlab # [ 248.436269] gitaly[913]: time="2026-10-17T17:26:48.968Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:48.968" grpc.time_ms=0.374 pid=913 span.kind=server system=grpc2057gitlab # [ 248.463067] gitaly[913]: time="2026-10-17T17:26:48.995Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:48.994" grpc.time_ms=0.743 pid=913 span.kind=server system=grpc2058gitlab # [ 248.464270] gitaly[913]: time="2026-10-17T17:26:48.996Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M55EDSRVMYB0MCXVC9X67T3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:58.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:48.988" grpc.time_ms=8.25 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 248.489725] gitaly[913]: time="2026-10-17T17:26:49.021Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT diskcache=ba48bf86-a07a-4bd5-97f7-94e962921130 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:18.798" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:48.899" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 248.497362] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1692061gitlab # [ 248.501702] gitaly[913]: time="2026-10-17T17:26:49.022Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=86 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7197 command.oublock=0 command.real_time_ms=118 command.spawn_token_fork_ms=0 command.system_time_ms=69 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:18.798" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:48.899" grpc.time_ms=122.74 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 248.526848] gitaly[913]: time="2026-10-17T17:26:49.059Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-17T17:27:19.058" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:49.058" grpc.time_ms=0.521 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2063gitlab # [ 248.540738] gitaly[913]: time="2026-10-17T17:26:49.073Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSYEFN3SHM5KMKAT8BMJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:19.072" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:49.072" grpc.time_ms=0.377 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2064gitlab # [ 248.545257] gitaly[913]: time="2026-10-17T17:26:49.077Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:19.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:49.077" grpc.time_ms=0.358 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 248.551605] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.083Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6cfea6449a35736d652f70d5","created_at":"2026-10-17T17:26:49.082Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"f1a09d301290126cd0cab10f","job_size_bytes":3,"pid":2495,"job_status":"deduplicated","message":"PipelineProcessWorker JID-6cfea6449a35736d652f70d5: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2066gitlab # [ 248.552619] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.084Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f1a09d301290126cd0cab10f","created_at":"2026-10-17T17:26:48.820Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-96679adc6aec4230","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:48.823Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2495,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f1a09d301290126cd0cab10f: rescheduled"}2067gitlab # [ 248.556835] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.088Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f1a09d301290126cd0cab10f","created_at":"2026-10-17T17:26:48.820Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-96679adc6aec4230","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:48.823Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f1a09d301290126cd0cab10f: done: 0.264021 sec","job_status":"done","queue_duration_s":0.001259,"scheduling_latency_s":0.001288,"gitaly_calls":3,"gitaly_duration_s":0.129446,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008925,"redis_read_bytes":239,"redis_write_bytes":21782,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000571,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000812,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002114,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.003395,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00013,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000335,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084689,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.214295113,"duration_s":0.264021,"completed_at":"2026-10-17T17:26:49.088Z","load_balancing_strategy":"primary","db_duration_s":0.024644,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2068gitlab # [ 248.617819] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.089Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3db00c4932fdce1d38e19f2e","created_at":"2026-10-17T17:26:48.893Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:48.894Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3db00c4932fdce1d38e19f2e: start","job_status":"start","queue_duration_s":0.195069,"scheduling_latency_s":0.195085}2069gitlab # [ 248.618665] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.114Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3db00c4932fdce1d38e19f2e","created_at":"2026-10-17T17:26:48.893Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:48.894Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3db00c4932fdce1d38e19f2e: done: 0.024468 sec","job_status":"done","queue_duration_s":0.195069,"scheduling_latency_s":0.195085,"redis_calls":7,"redis_duration_s":0.001072,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024468,"completed_at":"2026-10-17T17:26:49.114Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004343,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2070gitlab # [ 248.659811] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.115Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"41dfa04231cf5838d39c7357","created_at":"2026-10-17T17:26:49.026Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.028Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-41dfa04231cf5838d39c7357: start","job_status":"start","queue_duration_s":0.087137,"scheduling_latency_s":0.087151}2071gitlab # [ 248.662838] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.132Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"41dfa04231cf5838d39c7357","created_at":"2026-10-17T17:26:49.026Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.028Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-41dfa04231cf5838d39c7357: done: 0.017271 sec","job_status":"done","queue_duration_s":0.087137,"scheduling_latency_s":0.087151,"redis_calls":7,"redis_duration_s":0.001227,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017271,"completed_at":"2026-10-17T17:26:49.132Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2072gitlab # [ 248.701436] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.133Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d25e7dd2b5c9040f2a82bf41","created_at":"2026-10-17T17:26:49.031Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.034Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d25e7dd2b5c9040f2a82bf41: start","job_status":"start","queue_duration_s":0.099079,"scheduling_latency_s":0.099093}2073gitlab # [ 248.740571] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d25e7dd2b5c9040f2a82bf41","created_at":"2026-10-17T17:26:49.031Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.034Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d25e7dd2b5c9040f2a82bf41: done: 0.018924 sec","job_status":"done","queue_duration_s":0.099079,"scheduling_latency_s":0.099093,"redis_calls":7,"redis_duration_s":0.001336,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018924,"completed_at":"2026-10-17T17:26:49.152Z","load_balancing_strategy":"primary","db_duration_s":0.004862,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2074gitlab # [ 248.752979] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"70134e313c80263a977afa7e","created_at":"2026-10-17T17:26:49.039Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.040Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-70134e313c80263a977afa7e: start","job_status":"start","queue_duration_s":0.113408,"scheduling_latency_s":0.113422}2075gitlab # [ 248.767603] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.179Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"70134e313c80263a977afa7e","created_at":"2026-10-17T17:26:49.039Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.040Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-70134e313c80263a977afa7e: done: 0.025294 sec","job_status":"done","queue_duration_s":0.113408,"scheduling_latency_s":0.113422,"redis_calls":10,"redis_duration_s":0.002395,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000776,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025294,"completed_at":"2026-10-17T17:26:49.179Z","load_balancing_strategy":"primary","db_duration_s":0.0051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2076gitlab # [ 248.810746] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.180Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"508551f07c8777175c5ceee2","created_at":"2026-10-17T17:26:49.040Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.041Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-508551f07c8777175c5ceee2: start","job_status":"start","queue_duration_s":0.139209,"scheduling_latency_s":0.139235}2077gitlab # [ 248.821135] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.201Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"508551f07c8777175c5ceee2","created_at":"2026-10-17T17:26:49.040Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.041Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-508551f07c8777175c5ceee2: done: 0.020444 sec","job_status":"done","queue_duration_s":0.139209,"scheduling_latency_s":0.139235,"redis_calls":7,"redis_duration_s":0.001581,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020444,"completed_at":"2026-10-17T17:26:49.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2078gitlab # [ 248.870635] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f2d26ef569bdf744295d063f","created_at":"2026-10-17T17:26:49.042Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.043Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f2d26ef569bdf744295d063f: start","job_status":"start","queue_duration_s":0.159202,"scheduling_latency_s":0.159217}2079gitlab # [ 248.873712] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.219Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f2d26ef569bdf744295d063f","created_at":"2026-10-17T17:26:49.042Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.043Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f2d26ef569bdf744295d063f: done: 0.01698 sec","job_status":"done","queue_duration_s":0.159202,"scheduling_latency_s":0.159217,"redis_calls":8,"redis_duration_s":0.001622,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01698,"completed_at":"2026-10-17T17:26:49.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004198,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2080gitlab # [ 248.949682] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.220Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7719e29322aa1f0cad72ca36","created_at":"2026-10-17T17:26:49.044Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.045Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7719e29322aa1f0cad72ca36: start","job_status":"start","queue_duration_s":0.175851,"scheduling_latency_s":0.175865}2081gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses2082gitlab # [ 248.950483] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.235Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7719e29322aa1f0cad72ca36","created_at":"2026-10-17T17:26:49.044Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.045Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7719e29322aa1f0cad72ca36: done: 0.014654 sec","job_status":"done","queue_duration_s":0.175851,"scheduling_latency_s":0.175865,"redis_calls":7,"redis_duration_s":0.001341,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000359,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014654,"completed_at":"2026-10-17T17:26:49.235Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2083gitlab # [ 248.989156] gitaly[913]: time="2026-10-17T17:26:49.418Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-17T17:27:19.417" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:49.417" grpc.time_ms=0.641 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 248.989875] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.236Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"0e6439bb3321340068d6cf29","created_at":"2026-10-17T17:26:49.045Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.046Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0e6439bb3321340068d6cf29: start","job_status":"start","queue_duration_s":0.190079,"scheduling_latency_s":0.190092}2085gitlab # [ 248.990721] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.258Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"0e6439bb3321340068d6cf29","created_at":"2026-10-17T17:26:49.045Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.046Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0e6439bb3321340068d6cf29: done: 0.022395 sec","job_status":"done","queue_duration_s":0.190079,"scheduling_latency_s":0.190092,"redis_calls":7,"redis_duration_s":0.001448,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022395,"completed_at":"2026-10-17T17:26:49.258Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2086gitlab # [ 249.057411] gitaly[913]: time="2026-10-17T17:26:49.436Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSMAK2HPYQ1VXCB62SGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:19.435" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:49.435" grpc.time_ms=0.363 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 249.058041] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.260Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"18ce67742a9b9227baf67f7e","created_at":"2026-10-17T17:26:49.048Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.049Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-18ce67742a9b9227baf67f7e: start","job_status":"start","queue_duration_s":0.21028,"scheduling_latency_s":0.210295}2088gitlab # [ 249.058627] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.277Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"18ce67742a9b9227baf67f7e","created_at":"2026-10-17T17:26:49.048Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.049Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-18ce67742a9b9227baf67f7e: done: 0.017727 sec","job_status":"done","queue_duration_s":0.21028,"scheduling_latency_s":0.210295,"redis_calls":7,"redis_duration_s":0.0014010000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017727,"completed_at":"2026-10-17T17:26:49.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2089gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses, in 0.14 seconds)2090gitlab # [ 249.099747] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.278Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d444416b45f2c27f30f4b986","created_at":"2026-10-17T17:26:49.050Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.050Z","job_size_bytes":6,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d444416b45f2c27f30f4b986: start","job_status":"start","queue_duration_s":0.228015,"scheduling_latency_s":0.228029}2091gitlab # [ 249.103802] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.288Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d444416b45f2c27f30f4b986","created_at":"2026-10-17T17:26:49.050Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.050Z","job_size_bytes":6,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d444416b45f2c27f30f4b986: done: 0.009059 sec","job_status":"done","queue_duration_s":0.228015,"scheduling_latency_s":0.228029,"redis_calls":7,"redis_duration_s":0.001289,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009059,"completed_at":"2026-10-17T17:26:49.287Z","load_balancing_strategy":"primary","db_duration_s":0.000405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2092gitlab # [ 249.147286] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.289Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"73f66eabe05fb49fad682e28","created_at":"2026-10-17T17:26:49.051Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.052Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-73f66eabe05fb49fad682e28: start","job_status":"start","queue_duration_s":0.236955,"scheduling_latency_s":0.236967}2093gitlab # [ 249.187827] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"73f66eabe05fb49fad682e28","created_at":"2026-10-17T17:26:49.051Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.052Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-73f66eabe05fb49fad682e28: done: 0.020383 sec","job_status":"done","queue_duration_s":0.236955,"scheduling_latency_s":0.236967,"redis_calls":7,"redis_duration_s":0.002003,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001466,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020383,"completed_at":"2026-10-17T17:26:49.309Z","load_balancing_strategy":"primary","db_duration_s":0.003419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2094gitlab # [ 249.189326] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 712095gitlab # [ 249.190700] gitaly[913]: time="2026-10-17T17:26:49.642Z" level=info msg="finished unary call with code OK" catfile.duration_ms=16 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=16 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDTFK6V7PC2DSE27B6C13 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:19.625" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:49.625" grpc.time_ms=17.224 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 249.232245] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.310Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"e99909debffb01de7e68f2ac","created_at":"2026-10-17T17:26:49.085Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.085Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e99909debffb01de7e68f2ac: start","job_status":"start","queue_duration_s":0.22505,"scheduling_latency_s":0.22507}2097gitlab # [ 249.232920] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.444Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"e99909debffb01de7e68f2ac","created_at":"2026-10-17T17:26:49.085Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-fbbc353790124c75","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.085Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e99909debffb01de7e68f2ac: done: 0.13327 sec","job_status":"done","queue_duration_s":0.22505,"scheduling_latency_s":0.22507,"gitaly_calls":2,"gitaly_duration_s":0.003975,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006791,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00087,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000604,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000415,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001393,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001664,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000255,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.067,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.059,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056399,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.110429398,"duration_s":0.13327,"completed_at":"2026-10-17T17:26:49.444Z","load_balancing_strategy":"primary","db_duration_s":0.069867,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2098gitlab # [ 249.277790] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.445Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"6cdc0e57c151366a6de2f9ab","created_at":"2026-10-17T17:26:49.406Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-854917ba23fb45c7","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.408Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6cdc0e57c151366a6de2f9ab: start","job_status":"start","queue_duration_s":0.036946,"scheduling_latency_s":0.036962}2099gitlab # [ 249.278565] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"6cdc0e57c151366a6de2f9ab","created_at":"2026-10-17T17:26:49.406Z","trace_propagation_headers":{"sentry-trace":"7260976ed9b649dc96f461b3b0849965-854917ba23fb45c7","baggage":"sentry-trace_id=7260976ed9b649dc96f461b3b0849965,sentry-release=Unknown"},"correlation_id":"01M55EDSMAK2HPYQ1VXCB62SGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.408Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6cdc0e57c151366a6de2f9ab: done: 0.023001 sec","job_status":"done","queue_duration_s":0.036946,"scheduling_latency_s":0.036962,"redis_calls":7,"redis_duration_s":0.000959,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023001,"completed_at":"2026-10-17T17:26:49.468Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2100gitlab # [ 249.376162] gitaly[913]: time="2026-10-17T17:26:49.908Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M55EDSYEFN3SHM5KMKAT8BMJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T17:26:59.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:49.902" grpc.time_ms=5.65 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 249.401902] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:49.933Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c06a59ab4d65843264f0acc2","created_at":"2026-10-17T17:26:49.930Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-eb0f29c8b528414c","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.932Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c06a59ab4d65843264f0acc2: start","job_status":"start","queue_duration_s":0.001156,"scheduling_latency_s":0.001217}2102gitlab # [ 249.413432] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0bf727147db4ad4b5f61597b2acf332f6a704045 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 9072103gitlab # [ 249.544151] gitaly[913]: time="2026-10-17T17:26:50.076Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDSYEFN3SHM5KMKAT8BMJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:50.076" grpc.time_ms=0.268 pid=913 span.kind=server system=grpc2104gitlab # [ 249.571687] gitaly[913]: time="2026-10-17T17:26:50.103Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDSYEFN3SHM5KMKAT8BMJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:50.101" grpc.time_ms=1.987 pid=913 span.kind=server system=grpc2105gitlab # [ 249.585913] nixbot[2618]: {"ts": "2026-10-17T17:26:50.117Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 2, "sha": "0bf727147db4ad4b5f61597b2acf332f6a704045", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}2106gitlab # [ 249.599475] gitaly[913]: time="2026-10-17T17:26:50.131Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M55EDSYEFN3SHM5KMKAT8BMJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T17:26:50.130" grpc.time_ms=0.322 pid=913 span.kind=server system=grpc2107gitlab # [ 249.614744] gitaly[913]: time="2026-10-17T17:26:50.147Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSYEFN3SHM5KMKAT8BMJ diskcache=4e51b075-0a83-445c-bfa6-bc2c4bb757a0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:20.054" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:50.054" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 249.623523] gitaly[913]: time="2026-10-17T17:26:50.155Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=77 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7370 command.oublock=0 command.real_time_ms=86 command.spawn_token_fork_ms=2 command.system_time_ms=50 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSYEFN3SHM5KMKAT8BMJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-17T17:27:20.054" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T17:26:50.054" grpc.time_ms=92.36 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 249.649525] gitaly[913]: time="2026-10-17T17:26:50.181Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDV125BW8SZDAACRBHA38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:50.175" grpc.time_ms=5.624 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2110gitlab # [ 249.661269] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 352111gitlab # [ 249.688413] gitaly[913]: time="2026-10-17T17:26:50.220Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M55EDSYEFN3SHM5KMKAT8BMJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-17T17:27:20.219" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:50.220" grpc.time_ms=0.558 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 249.697794] gitaly[913]: time="2026-10-17T17:26:50.230Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDV27Q786SR4WNX246M47 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:50.224" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2113gitlab # [ 249.698694] gitaly[913]: time="2026-10-17T17:26:50.230Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDV27Q786SR4WNX246M47 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:50.224" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2114gitlab # [ 249.699443] gitlab-workhorse[827]: time="2026-10-17T17:26:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672115gitlab # [ 249.699882] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462116gitlab # [ 249.700633] gitaly[913]: time="2026-10-17T17:26:50.230Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDV27Q786SR4WNX246M47 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:50.224" grpc.time_ms=5.554 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2117gitlab # [ 249.762554] gitaly[913]: time="2026-10-17T17:26:50.294Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDSYEFN3SHM5KMKAT8BMJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:20.293" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:50.293" grpc.time_ms=0.765 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 249.785508] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.317Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c06a59ab4d65843264f0acc2","created_at":"2026-10-17T17:26:49.930Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-eb0f29c8b528414c","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:49.932Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c06a59ab4d65843264f0acc2: done: 0.384047 sec","job_status":"done","queue_duration_s":0.001156,"scheduling_latency_s":0.001217,"gitaly_calls":3,"gitaly_duration_s":0.178138,"redis_calls":73,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.01719,"redis_read_bytes":154,"redis_write_bytes":20037,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001043,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000949,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":23,"redis_queues_duration_s":0.002775,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13382,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.009398,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000274,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00037,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001338,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.161323,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.355806953,"duration_s":0.384047,"completed_at":"2026-10-17T17:26:50.317Z","load_balancing_strategy":"primary","db_duration_s":0.02935,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2119gitlab # [ 249.791696] gitaly[913]: time="2026-10-17T17:26:50.320Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M55EDV5DJCM18QXGHBDVHVQ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:50.314" grpc.time_ms=6.077 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2120gitlab # [ 249.837984] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 352121gitlab # [ 249.838716] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.324Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d74a102d82fda20145767d75","created_at":"2026-10-17T17:26:50.049Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.050Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d74a102d82fda20145767d75: start","job_status":"start","queue_duration_s":0.274051,"scheduling_latency_s":0.274084}2122gitlab # [ 249.839524] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.355Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d74a102d82fda20145767d75","created_at":"2026-10-17T17:26:50.049Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.050Z","job_size_bytes":23,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d74a102d82fda20145767d75: done: 0.031735 sec","job_status":"done","queue_duration_s":0.274051,"scheduling_latency_s":0.274084,"redis_calls":7,"redis_duration_s":0.002033,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031735,"completed_at":"2026-10-17T17:26:50.355Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00595,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2123gitlab # [ 249.884484] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.356Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"be4598a1d7de819e93cd200c","created_at":"2026-10-17T17:26:50.172Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.174Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-be4598a1d7de819e93cd200c: start","job_status":"start","queue_duration_s":0.182059,"scheduling_latency_s":0.182074}2124gitlab # [ 249.885170] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.404Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"be4598a1d7de819e93cd200c","created_at":"2026-10-17T17:26:50.172Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.174Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-be4598a1d7de819e93cd200c: done: 0.048075 sec","job_status":"done","queue_duration_s":0.182059,"scheduling_latency_s":0.182074,"redis_calls":7,"redis_duration_s":0.000969,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048075,"completed_at":"2026-10-17T17:26:50.404Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2125gitlab # [ 249.910752] gitaly[913]: time="2026-10-17T17:26:50.405Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M55EDV6KGC21VJ7F05JRER5G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:50.399" pid=913 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2126gitlab # [ 249.919933] gitlab-workhorse[827]: time="2026-10-17T17:26:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672127gitlab # [ 249.921643] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 832128gitlab # [ 249.923505] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.406Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b2404e610f2fdcf1878f07db","created_at":"2026-10-17T17:26:50.179Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.181Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b2404e610f2fdcf1878f07db: start","job_status":"start","queue_duration_s":0.224696,"scheduling_latency_s":0.224714}2129gitlab # [ 249.962655] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.428Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b2404e610f2fdcf1878f07db","created_at":"2026-10-17T17:26:50.179Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.181Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b2404e610f2fdcf1878f07db: done: 0.021848 sec","job_status":"done","queue_duration_s":0.224696,"scheduling_latency_s":0.224714,"redis_calls":7,"redis_duration_s":0.002137,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021848,"completed_at":"2026-10-17T17:26:50.427Z","load_balancing_strategy":"primary","db_duration_s":0.002839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2130gitlab # [ 249.974766] gitaly[913]: time="2026-10-17T17:26:50.405Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDV6KGC21VJ7F05JRER5G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:50.399" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2131gitlab # [ 249.986825] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"da6c5b8868ee6e7e29c0dcd5","created_at":"2026-10-17T17:26:50.186Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.196Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-da6c5b8868ee6e7e29c0dcd5: start","job_status":"start","queue_duration_s":0.23395,"scheduling_latency_s":0.233965}2132gitlab # [ 250.029903] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.457Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"da6c5b8868ee6e7e29c0dcd5","created_at":"2026-10-17T17:26:50.186Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.196Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-da6c5b8868ee6e7e29c0dcd5: done: 0.02665 sec","job_status":"done","queue_duration_s":0.23395,"scheduling_latency_s":0.233965,"redis_calls":10,"redis_duration_s":0.006274,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002022,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001608,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02665,"completed_at":"2026-10-17T17:26:50.457Z","load_balancing_strategy":"primary","db_duration_s":0.00451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2133gitlab # [ 250.039995] gitaly[913]: time="2026-10-17T17:26:50.406Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDV6KGC21VJ7F05JRER5G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T17:26:50.399" grpc.time_ms=6.995 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2134gitlab # [ 250.052678] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.458Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"226f08528030b72eb045f93c","created_at":"2026-10-17T17:26:50.197Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.198Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-226f08528030b72eb045f93c: start","job_status":"start","queue_duration_s":0.259413,"scheduling_latency_s":0.259427}2135gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses2136gitlab # [ 250.092676] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.473Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"226f08528030b72eb045f93c","created_at":"2026-10-17T17:26:50.197Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.198Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-226f08528030b72eb045f93c: done: 0.015485 sec","job_status":"done","queue_duration_s":0.259413,"scheduling_latency_s":0.259427,"redis_calls":7,"redis_duration_s":0.000859,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015485,"completed_at":"2026-10-17T17:26:50.473Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002278,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2137gitlab # [ 250.105638] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.474Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e4d1d4bc5fde45a48f7960f8","created_at":"2026-10-17T17:26:50.199Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.200Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e4d1d4bc5fde45a48f7960f8: start","job_status":"start","queue_duration_s":0.274009,"scheduling_latency_s":0.274022}2138gitlab # [ 250.147051] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.493Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e4d1d4bc5fde45a48f7960f8","created_at":"2026-10-17T17:26:50.199Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.200Z","job_size_bytes":19,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e4d1d4bc5fde45a48f7960f8: done: 0.019262 sec","job_status":"done","queue_duration_s":0.274009,"scheduling_latency_s":0.274022,"redis_calls":8,"redis_duration_s":0.001051,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019262,"completed_at":"2026-10-17T17:26:50.493Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2139gitlab # [ 250.155925] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.494Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0d1e0104e6052c9e98774e91","created_at":"2026-10-17T17:26:50.201Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.202Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0d1e0104e6052c9e98774e91: start","job_status":"start","queue_duration_s":0.292396,"scheduling_latency_s":0.29241}2140gitlab # [ 250.198254] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.508Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0d1e0104e6052c9e98774e91","created_at":"2026-10-17T17:26:50.201Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.202Z","job_size_bytes":66,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0d1e0104e6052c9e98774e91: done: 0.01358 sec","job_status":"done","queue_duration_s":0.292396,"scheduling_latency_s":0.29241,"redis_calls":7,"redis_duration_s":0.0009699999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01358,"completed_at":"2026-10-17T17:26:50.508Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2141gitlab # [ 250.241550] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.509Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"dbea1a48dec66a36e43a685f","created_at":"2026-10-17T17:26:50.202Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.203Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-dbea1a48dec66a36e43a685f: start","job_status":"start","queue_duration_s":0.305295,"scheduling_latency_s":0.305317}2142gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses, in 0.16 seconds)2143(finished: subtest: eval and build post commit statuses, in 8.11 seconds)2144(finished: run the VM test script, in 299.41 seconds)2145gitlab # [ 250.242259] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.528Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"dbea1a48dec66a36e43a685f","created_at":"2026-10-17T17:26:50.202Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.203Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-dbea1a48dec66a36e43a685f: done: 0.019991 sec","job_status":"done","queue_duration_s":0.305295,"scheduling_latency_s":0.305317,"redis_calls":7,"redis_duration_s":0.0008719999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019991,"completed_at":"2026-10-17T17:26:50.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2146gitlab # [ 250.288443] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.529Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"f958f81045e3d87f0886fb98","created_at":"2026-10-17T17:26:50.206Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.207Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f958f81045e3d87f0886fb98: start","job_status":"start","queue_duration_s":0.322113,"scheduling_latency_s":0.322126}2147gitlab # [ 250.289171] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.545Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"f958f81045e3d87f0886fb98","created_at":"2026-10-17T17:26:50.206Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.207Z","job_size_bytes":3,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f958f81045e3d87f0886fb98: done: 0.01578 sec","job_status":"done","queue_duration_s":0.322113,"scheduling_latency_s":0.322126,"redis_calls":7,"redis_duration_s":0.0008820000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01578,"completed_at":"2026-10-17T17:26:50.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2148gitlab # [ 250.315050] gitaly[913]: time="2026-10-17T17:26:50.803Z" level=info msg="finished unary call with code OK" catfile.duration_ms=73 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=73 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M55EDVJB8C0BT5GD5S825ZC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-17T17:27:20.729" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T17:26:50.729" grpc.time_ms=73.661 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 250.366451] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/10/17:17:26:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0bf727147db4ad4b5f61597b2acf332f6a704045/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1222150test script finished in 299.49s2151cleanup2152kill QemuMachine (pid 46)2153gitlab # [ 250.368069] sidekiq-cluster[2495]: {"severity":"INFO","time":"2026-10-17T17:26:50.546Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2e7e052cdafb1a5708b55d88","created_at":"2026-10-17T17:26:50.208Z","trace_propagation_headers":{"sentry-trace":"acb37324142d4dfe9bed598737331db9-d06f688e108a41d0","baggage":"sentry-trace_id=acb37324142d4dfe9bed598737331db9,sentry-release=Unknown"},"correlation_id":"01M55EDSYEFN3SHM5KMKAT8BMJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-17T17:26:50.209Z","job_size_bytes":6,"pid":2495,"sidekiq_tid":"m7zf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2e7e052cdafb1a5708b55d88: start","job_status":"qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2154gitlab # s2155(finished: cleanup, in 1.63 seconds)2156additionally exposed symbols:2157 gitlab,2158 vlan1,2159 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2160[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-17T17:25:56.048Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2161[]2162[]2163[]2164[]2165[]2166[]2167[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-17T17:26:41.884607Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2168[]2169[{'id': 5, 'sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-17T17:26:43.725Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2170[{'id': 5, 'sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-17T17:26:43.725Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2171[{'id': 5, 'sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-17T17:26:43.725Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2172[{'id': 5, 'sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-17T17:26:43.725Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2173[{'id': 5, 'sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-17T17:26:43.725Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2174[{'id': 5, 'sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-17T17:26:43.725Z', 'started_at': None, 'finished_at': '2026-10-17T17:26:48.814Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-10-17T17:26:49.014Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2175[{'id': 5, 'sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-17T17:26:43.725Z', 'started_at': None, 'finished_at': '2026-10-17T17:26:48.814Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '0bf727147db4ad4b5f61597b2acf332f6a704045', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-17T17:26:49.014Z', 'started_at': None, 'finished_at': '2026-10-17T17:26:49.922Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]